Search Backend Changes

## Admin No.188 View ViewReplyLast 50ReportDelete
The search backend for wakarimasen has been reworked.

Historically most Fuuka archives use Sphinx Search to provide searching functionality. As I understand it, most archives have trouble managing Sphinx cost effectively once they start archiving hundreds of millions of posts. In order to explore new to provide search, I looked into Postgres full text search - while it worked there were some problems (1) RAM and Disk usage was higher than I liked (2) there were several complaints about the searching system (>>74, >>66) (3) Limitations in SQL caused pathological performance pitfalls when there were a lot of matches, but the result set needed to be sorted by post date.

This new system based on a new-ish Rust project which is based on a lucene-like search library functions more typically like a search engine. There are several advantages, among them being reduced server usage and increased speed - as well as being able to index and search all posts in the database (even Sphinx is limited to 50,000 posts on most other archives). However this project is pretty new (I came across a couple bugs just trying to get it up and running), and I want to see how well it works for users.

Please post feedback and searches you have made in this thread and any unexpected results. I will unlikely be implementing new features (such as wildcard search), but I want most queries to be handled.

Lastly, thanks for all the individuals who have donated over the past couple weeks. For others, right now, I'm only supporting BTC, ETH and BAT - I will have to figure out how to setup wallets for every other shitcoin under the sun that people want to donate under.

>BTC: 1LQ6723An3ERoRHJC8B3e3eCSrgSRY3oP3
>ETH: 0x13dD4FD1349a676D9e948774dded9e0Dd17C63DD
94 posts and 5 images omitted

No.350 View ViewReplyReportDelete
You will never be a real woman. You have no womb, you have no ovaries, you have no eggs. You are a homosexual man twisted by drugs and surgery into a crude mockery of nature’s perfection.

All the “validation” you get is two-faced and half-hearted. Behind your back people mock you. Your parents are disgusted and ashamed of you, your “friends” laugh at your ghoulish appearance behind closed doors.

Men are utterly repulsed by you. Thousands of years of evolution have allowed men to sniff out frauds with incredible efficiency. Even trannies who “pass” look uncanny and unnatural to a man. Your bone structure is a dead giveaway. And even if you manage to get a drunk guy home with you, he’ll turn tail and bolt the second he gets a whiff of your diseased, infected axe wound.

You will never be happy. You wrench out a fake smile every single morning and tell yourself it’s going to be ok, but deep inside you feel the depression creeping up like a weed, ready to crush you under the unbearable weight.

Eventually it’ll be too much to bear - you’ll buy a rope, tie a noose, put it around your neck, and plunge into the cold abyss. Your parents will find you, heartbroken but relieved that they no longer have to live with the unbearable shame and disappointment. They’ll bury you with a headstone marked with your birth name, and every passerby for the rest of eternity will know a man is buried there. Your body will decay and go back to the dust, and all that will remain of your legacy is a skeleton that is unmistakably male.

This is your fate. This is what you chose. There is no turning back.

No.319 View ViewReplyReportDelete
Why does opening images redirect to the message "Anonymous Proxy detected, click here." on effectivegatetocontent.com? If I turn off my VPN the image just redirects to an advertisement
3 posts omitted

search filter

No.324 View ViewReplyReportDelete
When searching on any board, using the filter "Only With Images" gives this error
>Whoops, looks like something went wrong.
But searching with the filter "Only Without Images" works just fine

Midline greentext isn't archived

No.312 View ViewReplyReportDelete
/mlp/thread/37909480#p37919165
Midline greentext isn't archived. ^example
Pic unrelated because the screenshot was "too small"

No.292 View ViewReplyReportDelete
hello sirs can i get /biz/ text archive 2017-2021 i want to build text sentiment analysis sir thanks sir please do the needful

No.304 View ViewReplyReportDelete
Does anyone archive 2chan.net boards and if not, is it supported by Torako or any other imageboard scraping software?

No.302 View ViewReplyReportDelete
Dumb question, how viable would it be to give us a "firehose" API like some sites do?