2 things..
1) he is trying to tire out Kyle, trigger any emotion that would disengage Kyle's mind
Littlefinger is looking for hooks he can snag and exploit
2) Littlefinger is trying to save his career… he is in danger of being disbarred for his conduct in court