Danique Rosius, 23, was released from prison on Tuesday after serving a sentence for an armed robbery and aggravated assault with a deadly weapon, the Polk County Sheriff’s Office said in a news release.

But that same day, a deputy with the sheriff’s office conducted a traffic stop on a car Rosius was a passenger in. The car was being driven by Rosius’s twin sister Monique Rosius,

The sheriff’s office said the deputy pulled the vehicle over on Hopson Road in Frostproof, Florida, because they noticed Danique Rosius was holding two unsecured toddlers in his lap while the vehicle was moving.

After the deputy activated his lights and sirens for the traffic stop, the vehicle drove slowly for another mile before finally pulling over, the sheriff’s office said.

Deputies searched the car and located a handgun and a loaded magazine next to it in the vehicle’s glove box, according to the sheriff’s office.

Danique Rosius told deputies that he didn’t know the gun was in the car and that he had just been released from state prison that day.

He was arrested and charged with possession of a firearm by a convicted felon, a second-degree felony, and booked into the Polk County Jail.

Online jail records show he was released on bond on Wednesday.

Polk County Sheriff Grady Judd said: “One would think if you’ve just been released from prison after being convicted of violent felonies, you would do everything in your power to not break the law again, or be anywhere near a firearm.

“This guy literally broke the law the same day he was released from custody, not to mention putting small children in danger. We hope he’s learned his lesson this time.”

According to the sheriff’s office, Danique Rosius’s criminal history includes an arrest for robbery in 2014, an arrest for armed robbery and aggravated assault with a deadly weapon in 2015, as well as an arrest for resisting arrest and giving false information to law enforcement officers.