Thanks, Chris and Julian. I bought mine from Ozscopes too...
Yes, Julian, that's what I meant. Chris also had a problem with a loose spring in the battery contact. I checked mine and it is not quite loose, but not quite firm either. I improved it a bit, but I will also buy some alfoil today.
Because I noticed that it improved, that's obviously the root of the problem. Thanks for the advice!