Exclude sidekick assessment

[cuzuco2]

Added excludeSidekick assessment

[dzehnder]

do we only need to check the root url?

[cuzuco2]

@dzehnder This is the library page, that being said that was the only page I found, if you know of any other let me know

[cuzuco2]

As we have seen the other ones to check are the ones in library.json, I'll check that

[dzehnder]

Some additional comments from meeting with Alvaro:
How can we check all possible URLs that relate to sidekick?
Solution for now: we scan the sidekick plugins listed in the config.json
To get the URLs for the Block library (if it is listed as a plugin) there is a library.json file

Some additional questions that came up:
Should any of the sidekick pages even exist on a prod page (with noindex) or should it not be published in the first place?
Is it enough to have noindex on root of the sidekick plugins or does every subfolder/plugin need the noindex propery?

[cuzuco2]

Maybe for the library page we could use also nofollow, to be sure that the block pages are not indexed, but that would mean that this is the only way for those pages to be discovered (which we are not sure)

But then again, maybe in the first place this pages shouldn't be out there published at all