User-agent: * Disallow: https://www.pombase.org/api/v1/dataset/latest/data/gene_subsets Disallow: https://www.pombase.org/api/v1/dataset/latest/data/gene_summaries Disallow: https://www.pombase.org/api/v1/dataset/latest/data/recent_references Disallow: https://www.pombase.org/api/v1/dataset/latest/data/term_subsets Disallow: /term/PBO:* Disallow: /jbrowse/ Disallow: /data/external_datasets/ Disallow: /external_datasets/