Home Community Paypal Open-Sources JunoDB: Its Distributed Key-Value Store

Paypal Open-Sources JunoDB: Its Distributed Key-Value Store

0
Paypal Open-Sources JunoDB: Its Distributed Key-Value Store

Paypal recently open-sourced JunoDB, a distributed key-value store built on RocksDB. Every day, JunoDB, PayPal’s highly available and security-focused database, processes 350 billion requests.

PayPal’s wide range of applications relies heavily on JunoDB, a distributed key-value store. JunoDB is used for virtually every critical backend service at PayPal, including authentication, risk assessment, and transaction settlement. Data could also be cached and accessed quickly from apps using JunoDB, reducing the strain on backend services and relational databases. JunoDB, nonetheless, will not be an abnormal NoSQL database. It was developed to fulfill PayPal’s specific requirements. Thus, it could concurrently manage many concurrent users and connections without slowing down. Originally inbuilt single-threaded C++, it has been rewritten in Golang to benefit from parallel processing and lots of cores. 

The JunoDB architecture is a dependable and extensible system that prioritizes ease of use, scalability, security, and adaptability. Proxy-based design simplifies development by abstracting away complex logic and setup from applications and allowing for linear horizontal connection scaling. When expanding or contracting clusters, JunoDB uses consistent hashing to separate data and reduce the quantity of knowledge that should be moved. JunoDB uses a quorum-based protocol and a two-phase commit to ensure data consistency and ensure there may be never any downtime for the database.

🚀 JOIN the fastest ML Subreddit Community

Protecting information each in transit and at rest is a high priority. Hence TLS support and payload encryption are implemented. Finally, JunoDB’s flexibility and talent to adapt over time are guaranteed by its pluggable storage engine design, which makes it easy to change to recent storage technologies as they change into available.

The core of JunoDB is made up of three interdependent parts:

  1. The JunoDB proxy allows application data to be easily stored, retrieved, and updated, because of the JunoDB client library’s provided API. With support for languages including Java, Golang, C++, Node, and Python, the JunoDB thin client library could be easily integrated with programs inbuilt various languages.
  2. Client queries and replication traffic from distant sites are processed by proxy instances of JunoDB which are controlled by a load balancer. Each proxy establishes a connection to all JunoDB storage server instances, and routes request to a set of storage server instances in keeping with the shard mapping stored in ETCD.
  3. JunoDB uses RocksDB to store data in memory or persistent storage upon receiving an operation request from a proxy.

JunoDB maintains high levels of accessibility and system responsiveness while supporting many client connections. It also manages data expansion and maintains high read/write throughput at the same time as data volume and access rates rise. To attain six 9s of system availability, JunoDB uses a combination of solutions, including data replication inside and outdoors data centers and failover mechanisms.

JunoDB provides exceptional performance at scale, managing even probably the most intensive workloads with response times within the millisecond range and without disrupting the user experience. As well as, JunoDB offers a high throughput and low latencies, enabling applications to scale linearly without compromising performance.

Users can get the source code for JunoDB, released under the Apache 2 license, on GitHub. PayPal produced server configuration and client development tutorial videos to help developers’ database use. The team plans to incorporate a Golang client and a JunoDB operator for Kubernetes in the longer term. 


Check Out The Reference Article. Don’t forget to hitch our 23k+ ML SubRedditDiscord Channel, and Email Newsletter, where we share the most recent AI research news, cool AI projects, and more. If you may have any questions regarding the above article or if we missed anything, be happy to email us at Asif@marktechpost.com

🚀 Check Out 100’s AI Tools in AI Tools Club


Tanushree

” data-medium-file=”https://www.marktechpost.com/wp-content/uploads/2020/10/Tanushree-Picture-225×300.jpeg” data-large-file=”https://www.marktechpost.com/wp-content/uploads/2020/10/Tanushree-Picture-768×1024.jpeg”>

Tanushree Shenwai is a consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Indian Institute of Technology(IIT), Bhubaneswar. She is a Data Science enthusiast and has a keen interest within the scope of application of artificial intelligence in various fields. She is keen about exploring the brand new advancements in technologies and their real-life application.


➡️ Try: Criminal IP: AI-based Phishing Link Checker Chrome Extension

LEAVE A REPLY

Please enter your comment!
Please enter your name here