CNCF end user technical radar: database storage (November 2020)

Time:2021-11-17

Today, CNCF released the third issue of CNCF end user technology radar in the quarter; The subject of radar technology is database storage.

In June, we launched CNCF end-user technology radar, a new initiative of CNCF end-user community. This is a group of more than 140 top companies and startups who meet regularly to discuss challenges and best practices in adopting cloud native technologies. The goal of CNCF end user technology radar is to share the tools that end users are actively using, the tools they recommend and their usage patterns. More information about this method can be found athereFound.

reachradar.cncf.ioOther radar, vote and representative industries can be found.

Please lock in the North American kubecon + cloudnativecon virtual conference in et time zone at 4:00 p.m. on Friday, November 20. Watch the on-site Q & a session of techradar, Cheryl hung and radar editors. You will hear more about the results.

Survey of database storage

In October 2020, members of the end-user community were asked what database storage solutions they evaluated, tested and subsequently adopted. A total of 273 data points were sorted and reviewed to determine the final location.

CNCF end user technical radar: database storage (November 2020)

This can be interpreted as:

  • The six tools in “adopt” were widely adopted and recommended by respondents.
  • The technology in trial has been recommended by some end users, but they either did not get enough overall response, or only a few people voted “adopt”.
  • The project of “assessment” lacks clear consensus. Have some knowledge of MariaDB, cockroachdb and Vites, but only a few users recommend it. Organizations looking for new database storage solutions should consider their own needs when considering the needs in the assessment.

theme

Topics describe interesting patterns and editorial observations:

1. The company is very cautious about its own data, and the speed of adopting new technologies is also very slow.

New technologies, such as cockroachdb, tidb and Vites, have not been widely studied by many responding companies. Cockroachdb and Vites finally appeared in the “assessment”.

Some different factors urge organizations to be cautious about their data, but the main reason is that it is difficult to manage. When a large amount of data (sometimes TB or Pb) is transferred from one data storage technology to another, there will be a lot of overhead. To be meaningful, the benefits must outweigh the costs. Even when transitioning from legacy solutions to cloud computing, some companies will consider integrating the tools they already have.

Another factor may be that it is more difficult to hire developers with expertise in these new technologies. All projects in the assessment (cockroachdb, MariaDB, and Vites) are API compatible with the technologies in adoption, so organizations can integrate elements without switching to new tools.

Interestingly, etcd did not appear on radar. The use of etcd is mainly driven by kubernetes because it is the only supported backend. Companies rarely use etcd as an independent data hosting option, which means that companies transitioning from legacy infrastructure are unlikely to have experience in using it.

2. The choice of managed database service depends largely on the use case.

We were surprised to see the low utilization of cloud management services. This makes us realize that the use of managed database services may vary greatly according to different use cases – the location of application deployment, the amount of data stored, and whether cloud providers have been used. For example, if a company has a large amount of data, using a managed database solution may bring huge costs.

The use of cloud management database may be affected by whether the company is already using a specific cloud provider. For example, if a company only uses AWS on other cloud services, they are likely to use AWS related database technology. If they run locally, they probably won’t just run the database in the cloud.

In other cases, decisions may be driven by data security and protection. Companies dealing with sensitive data are more likely to establish databases internally and may even be required to do so.

Although we did ask about RDS, it didn’t appear on the radar in the end. We deleted it because its usage is ambiguous and it is not clear what special technology is used.

3. Keep an open mind!

We find that database storage is still an evolving field. Some projects have existed for a long time, which may improve their adoption rate, especially considering their use in large companies. Many of these legacy technologies enjoy a good reputation because they are stable and have proven to work.

New cloud native projects are emerging, many of which are more suitable for new use cases. Some new technologies with special use cases did not enter the radar; We don’t see any graphical databases, long-term storage of indicators or serverless databases.

Ultimately, you must choose the right technology for you, your team and your organization. Is it more meaningful to use a technology that you can intervene and replace at any time than to force engineers to adapt to a technology? Is there a thriving community behind the open source project you are considering? Do your research and do meaningful things, but don’t be afraid to try new things!

edit

Jackie Fong is the engineering director of Ticketmaster Platform Department, responsible for container scheduling, CI / CD, observation ability and development experience. In early 2020, Jackie set up a service network end-user group at CNCF and served as co chair.

Smaine kahlouch is the head of Devops team at DailyMotion. He led a team responsible for building a reliable and scalable platform and release management. He is the organizer of CNCF meetup in Paris and CNCF ambassador in France. Twitter:smana

Mya pitzeruse is the chief engineer of indeed’s Service Platform Department, responsible for designing and guiding the development of cloud native platforms across computing, storage and observation. Twitter: myajpitz

Reading extension

Case study: UnderstandingJD.COMSlackandSquareHow to use CNCF technology to deal with database storage.

next

The next CNCF end-user technology radar will be released in February 2021, focusing on a different theme of cloud native.Vote to help decide the subject of the next CNCF end-user technology radar

Join CNCF end user community

  • Find out who is using each item and read their comments.
  • Contribute and edit future CNCF end user technology radar.

We are happy to provide this report to the community, and we are happy to hear your thoughts. Send feedback email to [email protected]

About methods

In October 2020, 140 companies in the CNCF end-user community described their suggestions for different solutions: suspension, evaluation, testing or adoption. They can also give more detailed comments. Because the answers are submitted through Google spreadsheets, they are neither confidential nor anonymous in the group.

29 companies submitted 273 data points on 36 solutions. These are sorted to determine the final location. Finally, edit the theme to reflect the broader pattern.

Click to read the original website


CNCF (cloud native Computing Foundation) was established in December 2015 and belongs to Linux   Foundation is a non-profit organization.
CNCF (cloud native Computing Foundation) is committed to cultivating and maintaining a vendor neutral open source ecosystem to promote cloud native technology. By democratizing the most cutting-edge models, we make these innovations available to the public. Scanning two-dimensional code concerns CNCF WeChat official account.
CNCF end user technical radar: database storage (November 2020)

Recommended Today

Modify user information changeinfo

When judging the persistence layer: Problem: there is such a problem when modifying user information. For example: the user’s email is not required. It was not empty originally. At this time, the user deletes the mailbox information and submits it. At this time, if it is not empty to judge whether it needs to be […]