Advanced AI Prompt for Robots.txt and Meta Robots Conflict Resolution

Act as a Search Engine Indexing Specialist. Script an agent to cross-reference and resolve fatal conflicts between the global [ROBOTS_TXT_CONTENT] and the page-level [META_ROBOTS_DATA]. The agent must: 1) Hunt down the infamous 'Blocked but Indexed' paradox: URLs explicitly blocked by a `Disallow` rule in robots.txt, but which also contain an HTML `<meta name='robots' content='noindex'>` tag (meaning Googlebot cannot physically crawl the page to see the noindex directive, resulting in a dirty index). 2) Identify highly indexable URLs located in the [SITEMAP_INDEX] that are accidentally disallowed. 3) Detect complex `Allow` rules that are completely redundant or accidentally overridden by broader, more aggressive `Disallow` wildcard patterns. 4) Recommend a 'Logic Clean-up'. Output a mathematically revised `robots.txt` file and an exact list of URLs where 'Meta Robots' tags must be stripped to allow the robots.txt disallow to function properly.