Both destinations are served by Gwalior (GWL). Since there's no flight route between them, the best way to travel is by road.
Gwalior
Fly to Gwalior (GWL), then travel by road to Gwalior. Taxis, buses, and private cabs are available from the airport.
Jhansi
Fly to Gwalior (GWL), then travel by road to Jhansi. Local transport options include taxis, auto-rickshaws, and state buses.