A newly married woman was allegedly kidnapped at gunpoint by her former lover while returning home with her husband after their wedding ceremony early Sunday morning in Odisha's Bolangir district.