You may get a visit yes. The ‘inspectors’ are paid agents who earn commission by selling you a licence. They also like to scare people sometimes.
I have been visited multiple times, so have the people I have helped. The thing to remember is not to worry, open the door, be polite. If they say they are from TV licensing just close the door with a ‘no thank you’ and never sign anything.
They do not have the right to enter your property, so don’t be scared of them, just shut the door.