Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-

If you were to rebuild 4chan today...

Name: Anonymous 2012-12-27 4:27

...what type of data storage layout would you use?

Would you remain with a mostly flat file layout and what technologies would you use to implement such a layout?

Personally I'd go with JSON files and some random JSON library for writing, cache and reading stuff.

Name: Anonymous 2012-12-27 4:29

Personally I'd go with JSON files and some random JSON library for writing, cache and reading stuff.
I would ask you to go back to /g/ or whatever you came from, because you are exactly the kind of person that went with XML files and some random XML library for writing, cache and reading stuff 5 years ago.

Name: Cudder !MhMRSATORI!fR8duoqGZdD/iE5 2012-12-27 4:47

Name: Anonymous 2012-12-27 4:53

>>3
That.  I would also use the Spring framework to implement the scalable enterprise n-tier turkey anonymous inversion of control web forum solution.

Name: Anonymous 2012-12-27 5:16

Don't need a persistent database at all. Just use JSON with redis. Think about it, image boards prune content very rapidly so there's little use for a database. Archive 404'd threads as serialized JSON or plain HTML.

Name: Anonymous 2012-12-27 5:20

who gives a fuck what data storage layout you people would hypothetically use?

Name: Anonymous 2012-12-27 5:35

>>4
>n-tier turkey

Name: Cudder !MhMRSATORI!fR8duoqGZdD/iE5 2012-12-27 5:50

>>5
According to the front page there's 92GB of content in total for all of the boards.

If they split the boards across different servers they could hold everything in memory and not bother with persistent storage at all.

In that case, just store all the HTML pages and images in a huge in-memory hashtable.

128GB of DDR3 can be had for <$1000.

Name: Anonymous 2012-12-27 6:11

Personally I'd go with JSON files

Too much work. I'd just use Postgre SQL reliable and fast enough solution with minimum work. Who the fuck wanted to do anything extra in web development hell?

Name: Anonymous 2012-12-27 6:12

lel i would use fioc and redis and would have upvote/downvote buttons

Name: Anonymous 2012-12-27 6:27

>>8
You don't need to store images in memory.

Name: Anonymous 2012-12-27 6:31

>>11
you can just store them on the dedicated 4chan FBI wiretapper

Name: Anonymous 2012-12-27 7:02

>>9

>Too much work.

What? Please explain? I thought my solution would be simpler not more complicated.

Name: Anonymous 2012-12-27 8:45

>>2
Your comment offended my delicate anus.

Name: Anonymous 2012-12-27 9:32

>>13
Yes, your solution is simpler is starting from nothing. But I would use some bloated framework, like RoR or Django, and write maybe ten lines of code and be done with it. Those frameworks work with real databases. With files, you'd had to do some basic functionality yourself.

Though, files are not that bad choice for 4chan kind of simple site. But I'm just too lazy to do it that way.

Name: Anonymous 2012-12-27 9:56

>>1,9
You people choosing between JSON and Postgresql look like kids who decide what to use to build a rocket to fly to Mars: cardboard or modelling clay.

Name: Anonymous 2012-12-27 10:11

>>16
yeah because rebuilding 4chan is totally like building a rocket to fly to Mars...

Name: Anonymous 2012-12-27 11:55

>>16

Well enlighten us with your superior solution, then.

Name: Anonymous 2012-12-27 12:01

>>18
No problem. *grabs dick*

Name: Anonymous 2012-12-27 13:52

>>11
Why not? If it's there, use it. Why write everything to disk, using more power and making it slower for everyone?

Name: Anonymous 2012-12-27 13:54

>>20
So you can shut down and restart the computer for maintenance.

Name: Anonymous 2012-12-27 13:54

holding all ones shit in memory will do (this hi-tech hi-load technique is called ``redis'' nowadays). but i believe that content pruning was introduced because of technical feebleness.
i'll go with riak.

Name: Anonymous 2012-12-27 14:47

>>20
So you don't have to buy 128GB of RAM. And there's no penalty in serving static files from the file system.

Name: Anonymous 2012-12-27 20:40

>>21
Then you write the memory to disk.

>>23
there's no penalty in serving static files from the file system.
It's slow. It took me 653ms to fetch this page.

Name: Anonymous 2012-12-27 21:17

>>20
So my 3 month old thread isn't lost when moot decides to ruck around.

Not every board is /b/ speed.

Name: Anonymous 2012-12-27 21:17

>>24
>It took me 653ms to fetch this page.
That's different from simply taking a file and sending it directly down the user's throat (images).

Other data can stay in memory though.

Name: Anonymous 2012-12-27 21:33

Don't store the images in memory. Plain static files is fast enough, and you'll want to use a CDN.

Don't change these.
Name: Email:
Entire Thread Thread List