Police recovered a revolver with two rounds of ammunition.
Carlos the Jackal is reported to have been involved in 88 rape incidents and the murder of 14 people.
The son of a once most wanted criminal was on Friday gunned down by police in Jericho, Nairobi.
Described by police as Nairobi’s most wanted criminal - Shimoli Jnr was the son of Edward Maina Shimoli alias Carlos the Jackal who was arrested, jailed, then gunned down shortly after he finished his prison term in 2007.