I agree with OM47, there are two things that say you should wait. First, you clearly are not getting a clean zero reading at 12 hours of the nitrite, and we all know it behaves that way towards the end but eventually it will clearly be zero and that's when you are ok. Second, it really doesn't sound like you are raising ammonia to 5ppm. You keep saying 2.4ppm or 3ppm, things like that. The 5ppm level is important not for the size fish load but for the robust nature of the colonies at the point of switchover to normal tank maintenance. If they are nice and solid then they can drop down and adjust to whatever your first real fish load is with ease, without having any mini-spikes.
Remember, the test is very clear, you raise ammonia to 5ppm and then find that both ammonia and nitrite give clear zero readings at 12 hours or less later. That starts your "qualifying week" and you watch it repeat that for the better part of a week or so before getting fish.
~~waterdrop~~