For λ>0, let θ be the angle between the vectors a=i^+λj^-3k^ and b=3i^-j^+2k^. If the vectors a+b and a-b are mutually perpendicular, then the value of (14cosθ)2 is equal to
(3)
a+b,a-b are mutually perpendicular ⇒(a+b)·(a-b)=0⇒a2-b2=0
⇒|i^+λj^-3k^|2-|3i^-j^+2k^|2=0⇒1+λ2+9=9+1+4⇒λ2=4⇒λ=2 [∵λ>0]
cosθ=a·b|a||b|=(i^+2j^-3k^)·(3i^-j^+2k^)|i^+2j^-3k^||3i^-j^+2k^|
=3-2-61+4+99+1+4=-514
⇒14cosθ=-5⇒(14cosθ)2=25