I suspect you ran a normal character-based search (like you do for strings or IP addresses). You won't find the number that way since your editor looks for a normal "text" instead of an encoded number.
Just to make sure you didn't search for the wrong port number... 10103 should be the default login server port that is also present in the client executable.
Depending on your hex-editor, it's also possible the program doesn't support integer searches.