15
Azer0s
7y

A distributed NoSQL document store.

Project Type
Existing open source project
Summary

A distributed NoSQL document store.

Description
At the time the project is in a very early phase. I'm currently working out the architecture and I'd need 1 or 2 other people who'd be interested in the project and who are good at C#. The whole project is based around the idea of having socalled nodes instead of a single database. There are 4 types of nodes which all have a different function. The nodes communicate with each other and work together to handle requests. In theory, one could add an infinite number of nodes to the cluster to distribute the workload even more. I've built a prototype for such a network with only 2 node-types and it worked out pretty good. I now want to make this an enterprise ready, open source solution. I don't really know how it'll turn out, but I might be on to something. Anyway...if you're interested just hit me up and we'll see how you can contribute to the project (again...I need experienced C# programmers). PM me for more information or just leave a comment.
Tech Stack
.net core
Current Team Size
1
URL
Comments
  • 0
    You did lose me when you say distributed
  • 1
    @Rabbyte Oh no...why is that? I'm quite a fan of distributed computing/databases...
  • 0
    What consensus algo are you working with? I’ve had a look at Raft before as I was thinking of writing a distributed file store for images inspired by the deepfakes stuff and the need for a repository of images and models.
  • 0
    I'm not an expert, but I'm pretty sure you won't reach unlimited scaling with C#, if unlimited scaling altogether
  • 1
    @Brolls Haven't figured that out yet...but probably going with Paxos.
  • 0
    @Kimmax We'll see...I'll keep you guys on DevRant updated... ;)
  • 0
    Sounds like socialism for databases. xD Go for it!
  • 0
    @c3ypt1c xD not really tho, because the whole concept is that not everyone has to have every bit of data, but everyone has to know where to find it.
  • 1
    @Azer0s it just seemed to me like you would distribute the data evenly across all nodes xD
  • 0
    @Azer0s last I looked Raft had some good things going for it over Paxos (according to their paper), it’s supposedly simpler. 👍
  • 0
    @Brolls Tbh...I'm not that familiar with Raft, therefore I just went with what I know. What's the difference?
  • 1
    https://raft.github.io/

    There’s a bunch of info here 👍
  • 0
    I am very familiar with C# but what exactly do you mean by document store?
  • 1
    Cassandra? Riak?
  • 0
    @vertti nah fam...I'ma reinvent the wheel out of this shit...
  • 0
    Aren't NoSQL DBs already distributed?

    MongoDB can do Sharding and I think Hadoop supports storing semi-unstructured data and whatever Facebook uses is definitely distributed?
  • 1
    @billgates Yes. But the thing is: I actually have a very specific usecase for my DB (it's for my diploma project...my diploma project partner had a very special request about handling the data, and after I did some research, I found out that something exactly like that doesn't exist yet).
  • 1
    @billgates It definitely started out as a fun project...but since I actually found a usecase (or better...since my diploma project partner found one) I actually need this.
Add Comment