Two possibilities...

[Angrboda]

The problem with that? The word in which Jesus used to identify 'peter' is not one of authority. Jesus was actually being a little insulting to peter/petros (translated: loose gravel/unsure footing/small stone) when He told Him of the 'rock'/petra in which He would build His church.

Besides all of that, Peter did not start the R/C Church, Peter did not have a big gentile ministry, and nothing ever written places him in Rome. it was Paul who started the church at rome, and nothing else ever written by Peter or Paul hinted at Apostolic powers/Authority being passed down.

Now he finds an argument from silence persuasive!