Project ChanText

'sup /prog/,

Having played with Markov-chain text generators, I came up with the idea of gathering statistics by parsing randomly selected threads from a certain board at periodic intervals, then using those accumulated word frequencies to generate text, which would then have the flavor of the board.

Your thoughts, /prog/?

Why overcomplicate things?


import sys
from random import randint

text = sys.stdin.read().split(" ")

words = {}
prev = "","\n"
for word in text:
        if prev in words:
                words[prev].append(word)
        else:
                words[prev] = [word]
        prev = prev[1], word

word = "","\n"
for i in range(10000):
        lst = words[word]
        ran = randint(0, len(lst)-1)
        word = word[1], lst[ran]
        print word[1],