I have admitted to experimenting with pot 2 1/2 years ago am i completely screwed on going military or LE?

I had experimented with pot (exactly six times) back in 2006 when I was attending college and willfully admitted it on my application with US Customs. They didn’t necessarily reject me but gave me the opportunity to fight it or to respectfully withdrawal from the process (I withdrew due to the fact I had lost interest with Customs and Border Patrol). They informed me that my admittance of experimenting with marijuana will follow my record and will come up on my background check if I ever pursue a federal or law enforcement career. My question is: I am about to sign up for the military here very shortly and the “pot questions” have me topsy-turvy on what to say and do; especially if I am trying for a military job that requires a security clearance and I’m nervous that the recruiter will tell me one thing when its actually another.