Alternative I: Can hike till Lampėdžiai and overnight there.
Alternative II: You can rent a bike and have a tour in Kaunas.