How do I prevent CTRL+PAGEUP from opening the program?

Click on Options | Preferences | Activation and change the Activation Key. If you choose the None – Do not hide option, then there will be no activation key associated with the program. Instead, Keyboard Express will behave just like any other program and will reside on your desktop and in the task bar.