Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
@filthyranter how well do they deal with large amounts of files? Quick google search reveals that they have probs with syncing at 500k files https://help.nextcloud.com/t/...
-
@zemaitis Better than Dropbox tbh.
It's self-hosted btw so kinda depends on the server's performance. Mine's hosted on a VPS with 1 vCPU and it runs ok when I'm the only one using it :P -
@filthyranter Im sure dropbox has good servers as well. My problem seeems to be software client related. Client just crashes at syncing.
-
@zemaitis Nextcloud doesn't crash there for me, and I have a lot of files as well.
-
@filthyranter how many are we talking about? At least 1 mil?
-
@zemaitis Yeah, that's about the current amount and there's more to come.
-
@Chubak As in: a Nextcloud :P
-
@filthyranter Which provider are you using for hosting nextcloud?
-
@zemaitis Uh
Buy a server where you have root access
Install Linux, nginx, PHP 7.3, PostgreSQL
That's where to start. There are a lot of guides for installing Nextcloud.
Basically, any provider where you can buy a server.
Mine's on the cheapest OVH VPS with remote, cheap storage lol -
@filthyranter I need more details on your ovh plan. I am not able to find anything with more than 100-200gb storage. Need at least 1-2tb :/
-
@zemaitis I said: EXTERNAL REMOTE STORAGE. So basically storage hosted somewhere else. Won't reveal where since it's a special deal with someone I know.
If you need a cheap VPS with more storage than 20 GB (lol), you gotta find a different provider. -
@filthyranter Actually first you said ovh vps with storage, now you're saying some shady remote storage with some shady deals. Anyways thanks for the recommendation man.
-
@zemaitis I said "remote, cheap storage", which was the shady remote storage ;)
It's just a friend of mine who has a server in a datacenter with too much storage, so he is returning a favor :) -
@zemaitis If you actually need to sync them at once, I recommend you actually use Nextcloud in conjuncton with rsync. I mean, on your own server that should be more than 7 files per second ;)
-
@filthyranter I bought a kimsufi.com vps from https://kimsufi.com/en/servers.xml/ the plan KS-3. I also installed nextcloud on it by following tutorial from https://howtoforge.com/tutorial/...
Syncing dropbox with nextcloud via rsync still limits me to 5-6 files per second (I guess this is limited by dropbox API).
However I noticed that syncing from my nextcloud instance to my local pc is no better. Syncing 3000 files under 5kb takes around 5 minutes. Is it normal or should I tweak my config, remove apache2, use nginx and try other something else? -
@zemaitis Wew, please use NGINX. Apache is horrible when it comes to this.
when your code is a mess but everything work out in the end
When you keep getting +1s on a rant you posted a month ago.
Go big or go home.
fcking dropbox. it seems that it doesn't work well with accounts which have over 300,000 files. In my case I have around 1,5 million files and total size is 500gb. Problem is that I am not able to sync them to my local machine. Every time I try to do that dropbox is stuck at "starting" and it's usage builds up till 3.5gb ram and then dropbox crashes.
What should I do if I want to sync everything in dropbox with my local machine in order to go through my old stuff and delete everything I don't need? I could do selective sync and go by chunks of 300k files, but it sounds like a pain in the ass since distribution of files across hundreds of folders is not even.
Maybe there is some better cloud service which deals better with large amounts of files? Maybe I could move all of my files from dropbox to that other cloud service and then sync it on my local machine properly?
rant