That all makes it a one instruction set CPU (and since there is only one possible instruction it need not be stored in the program).

But the 1 bit is a reference to memory, it has an address space os 2^1 (Q1 and Q2 on the 4099 output register file) and a word size of 1, which as you point out allows you to store only a binary state.