- 🇬🇧United Kingdom joachim
The source configuration is going to get more complicated with changes like ✨ Allow wildcard for URL source plugin Needs work and ✨ Allow callback for Url source, and single item Json plugin Needs work .
Right now, the structure of the Url source plugin configuration is:
source:
plugin: url
data_fetcher_plugin: http
data_parser_plugin: json
urls: /migrate_example_advanced_position?_format=json
authentication: # See
#2761489: Provide authentication plugins to HTTP fetcher →
item_selector: 1
fields:
...
ids:
...
Everything, even options specific to either the fetcher or parser, is at the source plugin configuration level. Ideally, I'd like things to be broken down cleanly between them, like
source:
plugin: url
fetcher:
plugin: http
authentication: # See
#2761489: Provide authentication plugins to HTTP fetcher →
parser:
plugin: json
# One might expect this to be a fetcher option, but the parser controls the fetcher, determining
# when to get the the next URL in the list, and the fetcher is designed for one URL at a time.
urls: /migrate_example_advanced_position?_format=json
item_selector: 1
fields:
...
ids:
...
Two issues with that:
Thoughts?
Active
6.0
Plugins
Not all content is available!
It's likely this issue predates Contrib.social: some issue and comment data are missing.
The source configuration is going to get more complicated with changes like ✨ Allow wildcard for URL source plugin Needs work and ✨ Allow callback for Url source, and single item Json plugin Needs work .