Trip To Japan In June

Hi, my wife and I will be traveling from Narita Airport to Kyoto on June 13th. Do wee need to stop in Tokyo station to change train (lines) to continue to Kyoto? Then we would like to travel from Kyoto to Osaka and from Osaka to Tokyo. At the end we will be traveling from Tokyo back to the Narita Airport.

Can we get to these cities using the JR Pass? If this is possible, can you tell me the lines we need to take for the following routes?

Narita Airport to Kyoto
Kyoto to Osaka
Osaka to Tokyo
Tokyo to Narita Airport

Do you think it will be cost effective for me to get a rail pass?

Thanks

Hector