i need some enlightenment about SgmlLinkExtractor in scrapy.
For the link: example.com/YYYY/MM/DD/title i would write:
For the link: example.com/news/economic/title should i write:
r'\news\w+/\w+' ? (category changes but the url contains always news)
For the link: example.com/article/title should i write:
r'\article\w+' ? (the url contains always article)