Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
Get a devDuck
Rubber duck debugging has never been so cute! Get your favorite coding language devDuckBuy Now
Search - "free tier"
I wrote a node + vue web app that consumes bing api and lets you block specific hosts with a click, and I have some thoughts I need to post somewhere.
My main motivation for this it is that the search results I've been getting with the big search engines are lacking a lot of quality. The SEO situation right now is very complex but the bottom line is that there is a lot of white hat SEO abuse.
Commercial companies are fucking up the internet very hard. Search results have become way too profit oriented thus unneutral. Personal blogs are becoming very rare. Information is losing quality and sites are losing identity. The internet is consollidating.
So, I decided to write something to help me give this situation the middle finger.
I wrote this because I consider the ability to block specific sites a basic universal right. If you were ripped off by a website or you just don't like it, then you should be able to block said site from your search results. It's not rocket science.
Google used to have this feature integrated but they removed it in 2013. They also had an extension that did this client side, but they removed it in 2018 too. We're years past the time where Google forgot their "Don't be evil" motto.
AFAIK, the only search engine on earth that lets you block sites is millionshort.com, but if you block too many sites, the performance degrades. And the company that runs it is a for profit too.
There is a third party extension that blocks sites called uBlacklist. The problem is that it only works on google. I wrote my app so as to escape google's tracking clutches, ads and their annoying products showing up in between my results.
But aside uBlacklist does the same thing as my app, including the limitation that this isn't an actual search engine, it's just filtering search results after they are generated.
This is far from ideal because filter results before the results are generated would be much more preferred.
But developing a search engine is prohibitively expensive to both index and rank pages for a single person. Which is sad, but can't do much about it.
I'm also thinking of implementing the ability promote certain sites, the opposite to blocking, so these promoted sites would get more priority within the results.
I guess I would have to move the promoted sites between all pages I fetched to the first page/s, but client side.
But this is suboptimal compared to having actual access to the rank algorithm, where you could promote sites in a smarter way, but again, I can't build a search engine by myself.
I'm using mongo to cache the results, so with a click of a button I can retrieve the results of a previous query without hitting bing. So far a couple of queries don't seem to bring much performance or space issues.
On using bing: bing is basically the only realiable API option I could find that was hobby cost worthy. Most microsoft products are usually my last choice.
Bing is giving me a 7 day free trial of their search API until I register a CC. They offer a free tier, but I'm not sure if that's only for these 7 days. Otherwise, I'm gonna need to pay like 5$.
Paying or not, having to use a CC to use this software I wrote sucks balls.
So far the usage of this app has resulted in me becoming more critical of sites and finding sites of better quality. I think overall it helps me to become a better programmer, all the while having better protection of my privacy.
One not upside is that I'm the only one curating myself, whereas I could benefit from other people that I trust own block/promote lists.
I will git push it somewhere at some point, but it does require some more work:
I would want to add a docker-compose script to make it easy to start, and I didn't write any tests unfortunately (I did use eslint for both apps, though).
The performance is not excellent (the app has not experienced blocks so far, but it does make the coolers spin after a bit) because the algorithms I wrote were very POC.
But it took me some time to write it, and I need to catch some breath.
There are other more open efforts that seem to be more ethical, but they are usually hard to use or just incomplete.
commoncrawl.org is a free index of the web. one problem I found is that it doesn't seem to index everything (for example, it doesn't seem to index the blog of a friend I know that has been writing for years and is indexed by google).
it also requires knowledge on reading warc files, which will surely require some time investment to learn.
it also seems kinda slow for responses,
it is also generated only once a month, and I would still have little idea on how to implement a pagerank algorithm, let alone code it.4
Sure Amazon, 0.02$/GB * 0.000120 GB = 0.01$, not 0.0000024$, sure, that's right.
0.05$ for what amounts to less than 2MB of data transfer in total (there's two more lines like that in the bill).
Eat a bag of dicks.
Free tier my ass, if I wanted to spend money I'd rather use Azure.3
Woke up this morning to Amazon charging me over $100 bucks for the web services I used at my Hackathon last month. What the hell, I thought the free tier covered that?14
How to make those marketing staff of x service stop sending you an email when they don't have unsubscribe link:
1. Reply back asking about the free tier/plan
2 days and no word from them after spamming me daily about the service3
Google cloud platform.
1. Great documentation and support
2. Good free tier & dev freebies
3. Cloud console + SDK rock
4. Did I mention the great documentation?
5. Seriously the documentation ❤
I'm so used to rss right now, I figured I would create a rss feed for top feeds from devrant.
Here's the unofficial devrant rss feed (based off Skayo's unofficial devRant api):
Just add this link to your rss reader (I'm using feedly) and it should be recognized instantly. Each feed will have the name of the ranter, rant, image, tags and user profile. I'm running this in free tier of Heroku. Feel free to use it.
You can find the source code here: https://github.com/Ullas-Aithal/...
It's a Node.JS script. There's a herokuBuild branch which it's heroku ready.
What do you guys think? Any comments, suggestions?11
Oh dear! Knew this email from Heroku was going to come saying I'm approaching by limit for the free Postgres database...Guess I'll have to start trying to monetize this website to pay for the next tier 😅2
Damit azure, few days ago I have to launch a server but azure didn't let me set up a credit card because I was on free tier period, but also tell that I'm not eligible for free tier, so, WTF??
I'd came back to AWS and some minutes later I get my fcking ec2 instance running without any problem.
Running NPM install on an average size project on a free tier Cloud9 instance.
Didn't go too well kept hitting memory limit which killed the NPM process.
Upgrade it is..
AWS Free Tier.
Has anyone got dome knowledge as to why is that even a thing? We can run hundres of thousands free lambda executions and a bunch of other things. I really wanna know what's the business model behind it and how is it beneficial for amazon to provide their services free of charge for so many.
I went ahead and tested t2.micro and lambda+dynamo(free tier)
You definitely get better performance and load handing with lambda+dynamo (5rcu+5wcu)
Tested the two with wrk and a simple GET which reads an item from a database of 90k items.
I could share more details with you if youre interested, but with 2000 requests, 100 connections and 4 threads. I got about 26requests/s on ec2 and about 260r/s on lambda.
Latency for ec2 was about 28s.
Latency for lambda was about 22s.
Got an email “Welcome to Amazon Web Services” to an old GMail account I no longer use. Seems genuine with no links to shady websites or anything. Does Amazon not verify email addresses or how does that happen?
Also, the mail says I have now 12 months of free tier access, so will they start billing me instead of the random fuck who signed up with my email address?3
Ok so, i have no idea where i can ask this kinda thing so i'm asking it here (i know i could do like stackexchange or dead aws discord servers, ... nvm you know why i'm not going that route).
I'm looking for a comparison between a mongo+node setup on a basic t1.micro instance and a lambda+dynamodb setup.
Each one has it's perks obviously but i guess i sorta prefer whichever one gives best performance on the free tier.
I do know dynamo has 25 reads and 25 writes a second on the free tier, which might be a little less ? I really have no clue.
But how many writes/reads would a basic mongo setup be able to achieve on the t1.micro instance ? Any idea? Do share your experiences with these architectures as well. I'm sort of a newb with serverless, the downsides aren't worth it for me but I'm learning it nevertheless. It sorta tickles some sort of self-torture curiosity fetish (need more self-research to back that).10
(sort of rant but not totally)
so I am using Directus for headless cms and I'm always looking around for other options such as Contentful, but the problem with Contentful is that it is hella expensive in my opinion (249$/month at least after you exceed the free tier with limited capabilities)
So the real question is, do you guys know of any other Headless CMS?