Blog
FAQ
Discussions
Search
Projects, issues, users, and merge requests.
Project ID, name, and description.
User nickname, name, and org.
Issue ID, title, and summary.
Merge request titles.
Contrib
.social
Feed
Live feed
Builds
Live builds
Core
Tags
Tags and Initiatives
Data Pipelines
Open on Drupal.org โ
Open on Drupal GitLab โ
Created on 16 August 2021,
over 3 years ago
Maintained by
๐ฆ๐บ
Australia
acbramley
๐จ๐ฆ
Canada
jibran
๐ฆ๐บ
Australia
kim.pepper
๐ฆ๐บ
Australia
larowlan
๐ฆ๐บ
Australia
mortim07
๐ฆ๐บ
Australia
nterbogt
๐ฆ๐บ
Australia
sime
Clone
Clone with SSH
Clone with HTTPS
Clone with
doGit
๐ฆ๐บ
Australia
75%
๐ดโโ ๏ธ
17%
๐จ๐ฆ
Canada
8%
Top 3 contributors
Department of Premier and Cabinet - Victoria, Australia
33%
๐ฆ๐บ
@yovince
Department of Customer Service, NSW
17%
๐ฆ๐บ
@mortim07
University of Technology, Sydney
8%
๐ฆ๐บ
@pghaemim
and 4 individuals
( 42% )
๐จ๐ฆ
@jibran
๐ฆ๐บ
@nterbogt
๐ฆ๐บ
@owenmck
@project update bot
Follow
Sign in to follow projects
Merge Requests
More
!30
Automated Drupal 11 compatibility fixes for data_pipelines
Open
Show issue
project update bot
updated
17 days ago
!29
CSV data header row whitespace needs to be cleaned up
Open
Show issue
๐ฆ๐บ
Australia
yovince
updated
about 2 months ago
!26
Automated Drupal 11 compatibility fixes for data_pipelines
Open
Show issue
project update bot
updated
2 months ago
!23
Fixing an issue created by #3405873
Merged
Show issue
๐ฆ๐บ
Australia
mortim07
updated
2 months ago
!28
Complete the fix for bulk indexing on Elasticsearch endpoint
Open
Show issue
๐ฎ๐ณ
India
sourav_paul
updated
6 months ago
!27
Add getFileUrl method to FileDestinationBase and provide cache buster
Merged
Show issue
๐ฎ๐ณ
India
mohit_aghera
updated
7 months ago
More Merge Requests
Issues
๐
Automated Drupal 11 compatibility fixes for data_pipelines
Active
Code
Created
17 days ago
v2.0
project update bot
17 days ago
๐
CSV data header row whitespace needs to be cleaned up
Active
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
Nadim Hossain
about 2 months ago
๐
Fixing an issue created by #3405873
Active
Code
Created
10 months ago
v1.0
๐ฆ๐บ
Australia
mortim07
2 months ago
โจ
Add a callback transform plugin
Active
Code
Created
9 months ago
v1.0
๐ฆ๐บ
Australia
tinny
3 months ago
โจ
Listing page lacks filter
Active
User interface
Created
3 months ago
v1.0
๐ฆ๐บ
Australia
owenmck
3 months ago
๐
Complete the fix for bulk indexing on Elasticsearch endpoint
Needs review
Code
Created
6 months ago
v1.0
๐ฆ๐บ
Australia
yovince
4 months ago
๐
Memory limit issue with large JSON files.
Active
Code
Created
5 months ago
v1.0
๐ฆ๐บ
Australia
cman9090
5 months ago
โจ
Add getFileUrl method to FileDestinationBase and provide cache buster
Fixed
Code
Created
8 months ago
v1.0
๐ฆ๐บ
Australia
mstrelan
7 months ago
โจ
Change drush data-pipelines:reindex to allow passing multiple values or globed values
Needs review
Code
Created
7 months ago
v1.0
๐ฆ๐บ
Australia
gordon
7 months ago
๐
Automated Drupal 11 compatibility fixes for data_pipelines
Needs review
Code
Created
8 months ago
v1.0
project update bot
8 months ago
๐
Fixing a few critical errors.
Fixed
Code
Created
10 months ago
v1.0
๐ฆ๐บ
Australia
mortim07
9 months ago
โจ
how to set a default value based on certain criteria?
Closed: won't fix
Code
Created
11 months ago
v1.0
๐ฆ๐บ
Australia
yovince
10 months ago
๐
Remove exception thrown when deleting an ES index that doesn't exist in favour of a warning
Fixed
Code
Created
11 months ago
v1.0
๐ฆ๐บ
Australia
mortim07
11 months ago
โจ
Add in SFTP support
Closed: duplicate
Code
Created
11 months ago
v1.0
๐ฆ๐บ
Australia
mortim07
11 months ago
๐
Allow unpublishing a pipeline
Fixed
Code
Created
about 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
12 months ago
๐
Unable to delete outdated records from the pipelines
Fixed
Code
Created
about 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
๐
Make Dataset entity bundle-able like media entity and allow selecting source resource
Closed: won't fix
Code
Created
about 3 years ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
๐
Destination file storage should clear existing file on dataset update
Fixed
Code
Created
about 2 years ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
๐
Ensure typed data prototypes are cached according to pipeline
Fixed
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
mortim07
about 1 year ago
๐
Add Gitlab CI support
Fixed
Code
Created
about 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
๐
Fix PHP constraint in composer.json
Fixed
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
larowlan
about 1 year ago
โจ
Move elasticsearch field mappings from data pipelines plugin to elasticsearch destination plugin
Needs work
Code
Created
almost 3 years ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
๐
Change bulk indexing on Elasticsearch endpoint to aim at a single index
Fixed
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
matthew.hallsworth.dpc
about 1 year ago
๐
Add Dataset processing events
Active
Code
Created
about 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
about 1 year ago
โจ
Allow analyzers to be specified for elasticsearch pipelines
Needs work
Code
Created
about 1 year ago
v1.0
๐ฆ๐บ
Australia
mstrelan
about 1 year ago
โจ
Add the destination information on the view page
Active
Code
Created
over 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Update readme to contain documentation around adding destinations
Fixed
Documentation
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
gumnut
over 1 year ago
๐
Support skip import rows if a field matches a certain value
Fixed
Code
Created
over 1 year ago
v1.0
๐ป๐ณ
Vietnam
tannguyenhn
over 1 year ago
๐ฑ
[META] Improve validation and indexing process speed for large data
Fixed
Code
Created
about 3 years ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
โจ
Add NULL destination plugin
Fixed
Code
Created
over 2 years ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Add row index to the validation message
Fixed
Code
Created
over 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Update the index logic and not to reindex whole dataset
Fixed
Code
Created
over 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Timeout when processing large files
Fixed
Code
Created
over 2 years ago
v1.0
๐ฆ๐บ
Australia
gordon
over 1 year ago
๐
Use bulk endpoint in Elastic search destination plugin
Fixed
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
larowlan
over 1 year ago
๐
Don't run validation if there are no defined constraints
Fixed
Code
Created
over 1 year ago
v1.0
๐ฆ๐บ
Australia
larowlan
over 1 year ago
โจ
Add an OpenSearch destination plugin
Needs work
Code
Created
almost 3 years ago
v1.0
๐ฆ๐บ
Australia
kim.pepper
over 1 year ago
โจ
Add API to fetch data using destination plugins
Active
Code
Created
over 3 years ago
v1.0
๐ฆ๐บ
Australia
acbramley
over 1 year ago
โจ
Add KV destination plugin
Active
Code
Created
over 2 years ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Fix the issues reported by phpcs
Closed: won't fix
Code
Created
over 1 year ago
v1.0
๐ต๐ญ
Philippines
paraderojether
over 1 year ago
๐
Do not loop over the generator in Dataset::data() instead use the validate date iterator
Closed: duplicate
Code
Created
over 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
๐
Fix the queuing logic for indexing
Closed: duplicate
Code
Created
over 1 year ago
v1.0
๐จ๐ฆ
Canada
jibran
over 1 year ago
โจ
Allow field validation/transform on nested JSON values
Closed: won't fix
Code
Created
over 3 years ago
v1.0
๐ฆ๐บ
Australia
tinny
over 1 year ago
contrib
.social
Blog
FAQ
Discussions
Production build 0.71.5
2024