Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-4041-

Shitsux

Name: Anonymous 2009-07-13 9:03

Hi /prog/,

I just finished on my "proof of concept" of a new compression algorithm, and frankly it's awesome.

At current guesstimations I could compress a 10MB file to about ~4MB in less than 30 seconds (Probably less than 5 seconds but I'm being cautious).

To decompress will take about a day. A whole day. Though I'm 100% certain that I could halve that time by using two cores, and CUDA/OpenCL/etc probably couldn't hurt either but I couldn't make a judgement on those.

So basically in 10 years time when we have 64+ cores and new super GPUs it'll be awesome right?

Name: Anonymous 2009-07-13 9:05

So basically in 10 years time when we have 64+ cores and new super GPUs it'll be awesome right?
No, we'll all be using FV's superior compression algorithm

Name: Anonymous 2009-07-13 9:16

>>2
i lol'd

Name: FrozenVoid 2009-07-13 11:38

>>1,2 I have much different problems:
Compressing time rises exponentially with each byte of input, and there is no way to reduce it(well beside increasing the filesize,which would remove the compression factor)  because the bruteforce search
for representations in formulas is very slow(due having to calculate the formula each time a variable changes).
On the other hand decompression is done in several seconds. It just builds the file by formula and writes it.


____________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
We've arranged a civilization in which most crucial elements profoundly depend on science and technology. We have also arranged things so that almost no one understands science and technology. This is a prescription for disaster. We might get away with it for awhile, but sooner or later this combustible mixture of ignorance and power is going to blow up in our faces.

Name: Anonymous 2009-07-13 11:53

>>1-5
Morons.

Name: Anonymous 2009-07-13 12:36

>>5

He he he

Name: FrozenVoid 2009-07-13 12:54

>>5 The idea its self isn't "impossible" just consider:
1.every file is number
2.If you get a formula to result in this number, and variables in the formula are smaller then file its compressed.
3.You can get Inexact results, like 9 can be 9.8 or 9.01 and still decompress into the same file.
4.By manipulating the file content/number (e.g. multiplying it by constant like (2^(8*filesize))) you can increase search space enormously and decompression is, just dividing the result by the same constant and discarding fractional parts.
5.You can use any formula(and using multiple formulas provides best convergence btw) to generate numbers, as long as its variables are compact:x*(j^c),x^y mod N, (x^y)*(v^c), (k^m)/(u^g)
and the result must fit into search space:example here:
file is integer 9
floatingpoint space 9.000... to 9.999......
with multiplication by constant(e.g. 100) 900.000... to 999.999....
with multiplication by formula(e.g. 2.45^7.1+1):5224.809348679253 to 5805.343720754726
 
____________________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
What Djisktra thinks of machines that could think is as relevant today as Algol Programmer's Guides

Name: Anonymous 2009-07-13 16:32

Sage for FV.

Name: Anonymous 2009-07-13 21:39

>>7
ENTERPRISE COUNTING ARGUMENT

Name: Anonymous 2009-07-13 23:32

a 10MB file
yeah that's real useful-like when discussing compression algorithms.

Name: Anonymous 2009-07-14 0:05

You are aware modern compression algorithms are better than this, yes?

Name: noko 2009-07-14 1:31

>>10
Merely to illustrate the insane amount of time it takes to decompress my good friend. I really meant something along the lines of "capable of compressing files to ~40% of their original size" since file size doesn't have any effect with mine (unless you get to ~< 100kb).

Name: noko 2009-07-14 1:40

>>11
I'm not really into this sort of thing - so I wouldn't know, it was just a "could this really work?" on an idea I had.

I did think that getting to 40% of the original size was pretty good since I thought RZip only got around 65-70% usually.

The whole point of this thread was that the decompression times are HILARIOUSLY BAD, and it is kind of dissappointing that people seem to be taking this so seriously.

Name: sage 2009-07-14 1:44

>>13 here
I know RZip isn't a compression algorithm, though I realise it sounds like I said that.

Name: Anonymous 2009-07-14 2:03

>>13
The whole point of this thread was that I am a MASSIVE TROLL, and it is kind of dissappointing that people seem to be taking this so seriously.

Name: Anonymous 2009-07-14 2:09

>>15
What makes you think he's trolling? I thought it was funny.

Name: Anonymous 2009-07-14 2:12

>>8
☣ Please try to ignore troll posts! ☣

http://userscripts.org/scripts/show/52726

Name: Andrey. 2009-07-14 4:26

Hi /prog/,

I just finished on my "proof of concept" of a new compression algorithm, and frankly it's awesome.

File with 100MB of white noise compresses to 10MB. I think Claude Shannon is an idiot.

It's awesome right? I'm not posting code because it's so good you'll steal it.

Name: Anonymous 2009-07-14 4:58

>>18
Maybe you never finished reading OP - It's useless, noone is going to wait a month to restore from backup just for an extra 20% compression.

Name: Anonymous 2009-07-14 5:26

>>18
Thread Title: Shitsux
OP: I had the shittiest idea ever isn't that awesome
/prog/: You're too full of yourself you shitty troll

???

Name: Anonymous 2009-07-14 5:47

>>19,20
You two want me to share my invention, don't you?!

Name: Anonymous 2009-07-14 6:45

Oh, and,

>>1,18,19
SPAWHBTC

Post your algorithm so that we can analyze it, otherwise you're a big fat liar.

Name: Anonymous 2009-07-14 6:58

>>19
Maybe you never started reading OP - It's useless, noone is going to wait several times as long to create a backup just for it to be several times as large.

Name: Anonymous 2009-07-14 8:27

>>22
Okay you got me or whatever I'm leaving now.

Name: Anonymous 2009-07-14 9:36

>>19
Maybe you don't understand compression.

Name: Anonymous 2009-07-14 9:54

Hey guys, >>1's codec scheme is so awesome, it's gonna become a fundamental part of Hurd and Duke Nukem Forever.

Name: Anonymous 2009-07-14 22:12

>>26
(Score:5, Funny)

Name: Anonymous 2009-07-15 0:21

>>26
But only if Duke Nukem Forever comes with WinFS support!

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 0:49

Compression; People always talk about counting argument,entropy and other esoteric stuff while
using archived files daily. Especially one stupid argument i hear is "You can't compress purely random data!"
Which is so silly, since 'purely random data' is worthless as output.


________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
Experience is never limited, and it is never complete; it is an immense sensibility, a kind of huge spider-web of the finest silken threads suspended in the chamber of consciousness, and catching every air-borne particle in its tissue.

Name: Anonymous 2009-07-15 1:23

>>29
Wtf. Pigeonhole principle, dude. Look it up.

Name: Anonymous 2009-07-15 5:14

>>29
Oh, so you think entropy is bullshit? If that's the case then please design a lossless compression algorithm that can indefinitely take its own output as input and always produce a considerable compression ratio.

Yeah, true random data can't be compressed to any useful degree because it doesn't contain enough redundancy. Note that it doesn't need to be actual random data. The output of a compression algorithm has enough entropy to be considered random, and an untrained eye can't distinguish the two.

Name: Anonymous 2009-07-15 5:17

>>17
Thanks.

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 5:20

>>31 Random means "I can't find order in this information" e.g. unsorted list
Entropy means "This ``random' information is magically different from all others" like prime numbers


______________________________
http://xs135.xs.to/xs135/09042/av922.jpg
You're supposed to be developing verbal abilities for your big aptitude test tomorrow.

Name: Anonymous 2009-07-15 5:41

>>33
lolwut

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 5:48

>>34
Information with high-entropy vs Random.

__________________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
A sword is never a killer, it's a tool in the killer's hands.

Name: Anonymous 2009-07-15 5:58

>>33
No, that's completely incorrect.
Entropy is nothing more than a measure of randomness. Also your example is retarded.

[1111111121111111] is an unsorted list of numbers, but it's not very random.

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 6:01

>>36
It could be random in context of a billion numbers of such length.

________________________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
Once a man has changed the relationship between himself and his environment, he cannot return to the blissful ignorance he left.

Name: Anonymous 2009-07-15 6:11

>>37
which is it, a billion numbers or of such length?

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 6:13

e.g.
[1111111121111111] list 1
[1111111111121111] list  2
[1211111111111111] list  3...

________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
Having dreams is what makes life tolerable.

Name: Anonymous 2009-07-15 6:39

>>39
But the measure of entropy obviously depends on the size of the sample.
0 is not at all random, but 068048180605 is. The entropy of the whole is independent of the entropy of its parts.
Your example is invalid in the sense that [1111111121111111][1111111111121111][1211111111111111] is a different set than [1111111121111111].

Name: =+=*=F=R=O=Z=E=N==V=O=I=D=*=+= !frozEn/KIg 2009-07-15 6:44

>>40 Its the same list, with 2 in different places.



___________________________________
http://xs135.xs.to/xs135/09042/av922.jpg
If there is no struggle, there is no progress.

Name: Anonymous 2009-07-15 7:07

>>40
Please try to ignore troll posts!

http://userscripts.org/scripts/show/52726

Name: Anonymous 2009-07-15 7:22

>>42
If I didn't want to reply to trolls, I wouldn't come to /prog/.

Name: Anonymous 2009-07-15 7:31

>>42
☣ Please try to ignore troll posts! ☣

Name: Anonymous 2009-07-15 8:07

>>43
Then don't!

Name: Anonymous 2009-07-15 8:24

>>45
But I do! Both!

Name: Anonymous 2009-07-15 9:09

>>46
Now you have two problems.

Don't change these.
Name: Email:
Entire Thread Thread List