@leshoshin.bsky.social
@newyorkautomuseum.bsky.social
@trix-start.bsky.social
@donnymirassou.bsky.social
@prieco.bsky.social
@ai-portal-post.bsky.social
@gilbertbystander.bsky.social
Who/what is the #KingfisherIngest user agent?
I'm suspecting, #AI #Crawler, but before I swing my banhammer, I'd like to know for sure first.
@hayesstw.bsky.socialA bloke in #Sweden just built a #searchengine to do what Google no longer does, and it works.
It's called #MarginaliaSearch.
It runs its own #crawler and builds its own #index instead of borrowing Bing's. No ads, no investors, & no loans.
marginalia-search.com
@eliasulrich.bsky.social"One guy in #Sweden built a #searchengine to fight Google, and it works.
It's called #MarginaliaSearch.
It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans."
@mastodon.girolab.foo♻️ eliasulrich: "One guy in #Sweden built a #searchengine to fight Google, and it works.
It's called #MarginaliaSearch.
It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.
What it does differently: it… hachyderm.io/@eliasulr…
@eliasulrich.hachyderm.io.ap.brid.gy"One guy in #Sweden built a #searchengine to fight Google, and it works.
It's called #MarginaliaSearch.
It runs its own #crawler and builds its own #index instead of borrowing Bing's. It has no ads, no investors, and no loans.
What it does differently: it ranks for text-heavy, non-commercial […]
@wildasoftware.bsky.social
@alexkearney.comHmmm... I think for my next project I'll re-do my web-scraper. Building a data-set should be an interesting engineering problem.
kongaloosh.com/e/2015/07/15/hmmm #programming #crawler #news