He did in fact try to ignore her as he left, getting progressively more antsy as he was being followed. This was an uncomfortably familiar feeling to the devils that were normally stalking him, and Konoe was considered climbing a building or running.

Unfortunately, he was absolutely and utterly lost, and from his body language it was pretty obvious he knew that Bobby was still there.