Xarn

It's been a long time since the last discussion on this topic.

Hello Xarn

>>57
Often enough.
One additional problem is the fact that Shii^tchan is a clusterfuck of bugs, and threads like http://dis.4chan.org/read/prog/1237515841 exist. Through the HTML interface that's passed over immediately, but through JSON there's a thousand posts there, each of which will trigger pulling a post through the HTML interface.
You can change your strategy specifically to deal with threads like that, but that will make the general case more problematic.

If you don't care about verifying tripcodes at all, the JSON interface is slightly faster than the HTML one, but it will still take a few hours.