Finnish is not necessarily more difficult than other languages. Actually it is quite logical. It is just completely different from any language that we speak.
There are barely any words which you can guess based on your current vocabulary, so you'll have to memorize seemingly random accumulations of letters.
example:
köyhä - poor
tykätä - to like
rautatieasema - train station
So either you are really creative with memory hooks or you'll just have to learn vocabulary constantly.
The same goes for the grammar. The usage of the different suffixes, the partitive and so on looks just intimidating to anyone who doesn't know any Finno-Ugric language.
It is, of course, possible to learn Finnish. It just won't come as easily to you as another Germanic or Romanic language.