After a lot of searching and grey hair, I seem to have found the issue:
In the SQL Configuration Manager, under IPAll there was a wrong (?) dynamic port (1399), for reasons I don't know. After I changed this to 1433 too, I can connect to the server through SSMS by entering the IP. I'll try...