Blog
FAQ
Discussions
Search
Projects, issues, users, and merge requests.
Project ID, name, and description.
User nickname, name, and org.
Issue ID, title, and summary.
Merge request titles.
Contrib
.social
Feed
Live feed
Builds
Live builds
Core
Tags
Tags and Initiatives
Data Pipelines
Open on Drupal.org β
Open on Drupal GitLab β
Created on 16 August 2021,
over 3 years ago
Maintained by
π¦πΊ
Australia
acbramley
π¨π¦
Canada
jibran
π¦πΊ
Australia
kim.pepper
π¦πΊ
Australia
larowlan
π¦πΊ
Australia
mortim07
π¦πΊ
Australia
nterbogt
π¦πΊ
Australia
sime
Clone
Clone with SSH
Clone with HTTPS
Clone with
doGit
π¦πΊ
Australia
93%
π΄ββ οΈ
5%
π¨π¦
Canada
2%
Top 5 contributors
Department of Customer Service, NSW
19%
π¦πΊ
@mortim07
Department of Premier and Cabinet - Victoria, Australia
9%
π¦πΊ
@yovince
Icon Agency, Australia
2%
π¦πΊ
@gumnut
Free Sauce
2%
π¦πΊ
@sime
University of Technology, Sydney
2%
π¦πΊ
@pghaemim
and 4 individuals
( 65% )
π¨π¦
@jibran
π¦πΊ
@nterbogt
π¦πΊ
@owenmck
@project update bot
Follow
Sign in to follow projects
Merge Requests
More
!36
Drush improvements
Merged
Show issue
π¦πΊ
Australia
nterbogt
updated
21 days ago
!35
Move elasticsearch destination plugin to a separate module
Merged
Show issue
π¦πΊ
Australia
nterbogt
updated
about 1 month ago
!13
Move elasticsearch field mappings from data pipelines plugin to elasticsearch destination plugin
Merged
Show issue
π¦πΊ
Australia
mortim07
updated
about 1 month ago
!29
CSV data header row whitespace needs to be cleaned up
Merged
Show issue
π¦πΊ
Australia
yovince
updated
about 1 month ago
!33
Update enum to meet standards
Merged
Show issue
π¦πΊ
Australia
nterbogt
updated
about 1 month ago
!34
Plugin conversion to attributes
Merged
Show issue
π¦πΊ
Australia
nterbogt
updated
about 1 month ago
More Merge Requests
Issues
β¨
Rebuild Datasets listing page with Drupal Views
Active
Code
Created
6 days ago
v2.2
π¦πΊ
Australia
gumnut
6 days ago
β¨
Drush improvements
Active
Code
Created
21 days ago
v2.1
π¦πΊ
Australia
nterbogt
7 days ago
π
Move elasticsearch destination plugin to a separate module
Active
Code
Created
about 1 month ago
v2.0
π¦πΊ
Australia
nterbogt
19 days ago
β¨
Move elasticsearch field mappings from data pipelines plugin to elasticsearch destination plugin
Active
Code
Created
about 3 years ago
v1.0
π¨π¦
Canada
jibran
19 days ago
π
CSV data header row whitespace needs to be cleaned up
Active
Code
Created
over 1 year ago
v1.0
π¦πΊ
Australia
Nadim Hossain
20 days ago
π
Update enum to meet standards
Active
Code
Created
about 1 month ago
v2.0
π¦πΊ
Australia
nterbogt
20 days ago
π
Plugin conversion to attributes
Active
Code
Created
about 1 month ago
v2.0
π¦πΊ
Australia
nterbogt
20 days ago
π
Fixing an issue created by #3405873
Active
Code
Created
about 1 year ago
v1.0
π¦πΊ
Australia
mortim07
20 days ago
π
Automated Drupal 11 compatibility fixes for data_pipelines
Active
Code
Created
3 months ago
v2.0
project update bot
20 days ago
π
Permissions issues
Active
Code
Created
about 1 month ago
v1.0
π¦πΊ
Australia
nterbogt
20 days ago
β¨
Change drush data-pipelines:reindex to allow passing multiple values or globed values
Active
Code
Created
10 months ago
v1.0
π¦πΊ
Australia
gordon
21 days ago
β¨
Add an OpenSearch destination plugin
Needs work
Code
Created
about 3 years ago
v1.0
π¦πΊ
Australia
kim.pepper
26 days ago
β¨
Allow analyzers to be specified for elasticsearch pipelines
Active
Code
Created
over 1 year ago
v1.0
π¦πΊ
Australia
mstrelan
27 days ago
π
Automated Drupal 11 compatibility fixes for data_pipelines
Needs review
Code
Created
10 months ago
v1.0
project update bot
about 1 month ago
β¨
Listing page lacks filter
Active
User interface
Created
6 months ago
v1.0
π¦πΊ
Australia
owenmck
about 1 month ago
β¨
Add a callback transform plugin
Active
Code
Created
11 months ago
v1.0
π¦πΊ
Australia
tinny
5 months ago
π
Complete the fix for bulk indexing on Elasticsearch endpoint
Needs review
Code
Created
8 months ago
v1.0
π¦πΊ
Australia
yovince
7 months ago
π
Memory limit issue with large JSON files.
Active
Code
Created
8 months ago
v1.0
π¦πΊ
Australia
cman9090
8 months ago
β¨
Add getFileUrl method to FileDestinationBase and provide cache buster
Fixed
Code
Created
11 months ago
v1.0
π¦πΊ
Australia
mstrelan
9 months ago
π
Fixing a few critical errors.
Fixed
Code
Created
about 1 year ago
v1.0
π¦πΊ
Australia
mortim07
12 months ago
β¨
how to set a default value based on certain criteria?
Closed: won't fix
Code
Created
about 1 year ago
v1.0
π¦πΊ
Australia
yovince
about 1 year ago
π
Remove exception thrown when deleting an ES index that doesn't exist in favour of a warning
Fixed
Code
Created
about 1 year ago
v1.0
π¦πΊ
Australia
mortim07
about 1 year ago
β¨
Add in SFTP support
Closed: duplicate
Code
Created
about 1 year ago
v1.0
π¦πΊ
Australia
mortim07
about 1 year ago
π
Allow unpublishing a pipeline
Fixed
Code
Created
over 1 year ago
v1.0
π¨π¦
Canada
jibran
about 1 year ago
π
Unable to delete outdated records from the pipelines
Fixed
Code
Created
over 1 year ago
v1.0
π¨π¦
Canada
jibran
about 1 year ago
π
Make Dataset entity bundle-able like media entity and allow selecting source resource
Closed: won't fix
Code
Created
over 3 years ago
v1.0
π¨π¦
Canada
jibran
about 1 year ago
π
Destination file storage should clear existing file on dataset update
Fixed
Code
Created
over 2 years ago
v1.0
π¨π¦
Canada
jibran
over 1 year ago
π
Ensure typed data prototypes are cached according to pipeline
Fixed
Code
Created
over 1 year ago
v1.0
π¦πΊ
Australia
mortim07
over 1 year ago
π
Add Gitlab CI support
Fixed
Code
Created
over 1 year ago
v1.0
π¨π¦
Canada
jibran
over 1 year ago
π
Fix PHP constraint in composer.json
Fixed
Code
Created
almost 2 years ago
v1.0
π¦πΊ
Australia
larowlan
over 1 year ago
π
Change bulk indexing on Elasticsearch endpoint to aim at a single index
Fixed
Code
Created
over 1 year ago
v1.0
π¦πΊ
Australia
matthew.hallsworth.dpc
over 1 year ago
π
Add Dataset processing events
Active
Code
Created
over 1 year ago
v1.0
π¨π¦
Canada
jibran
over 1 year ago
β¨
Add the destination information on the view page
Active
Code
Created
over 1 year ago
v1.0
π¨π¦
Canada
jibran
over 1 year ago
π
Update readme to contain documentation around adding destinations
Fixed
Documentation
Created
over 1 year ago
v1.0
π¦πΊ
Australia
gumnut
over 1 year ago
π
Support skip import rows if a field matches a certain value
Fixed
Code
Created
almost 2 years ago
v1.0
π»π³
Vietnam
tannguyenhn
over 1 year ago
π±
[META] Improve validation and indexing process speed for large data
Fixed
Code
Created
about 3 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
β¨
Add NULL destination plugin
Fixed
Code
Created
almost 3 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
π
Add row index to the validation message
Fixed
Code
Created
almost 2 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
π
Update the index logic and not to reindex whole dataset
Fixed
Code
Created
almost 2 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
π
Timeout when processing large files
Fixed
Code
Created
over 2 years ago
v1.0
π¦πΊ
Australia
gordon
almost 2 years ago
π
Use bulk endpoint in Elastic search destination plugin
Fixed
Code
Created
almost 2 years ago
v1.0
π¦πΊ
Australia
larowlan
almost 2 years ago
π
Don't run validation if there are no defined constraints
Fixed
Code
Created
almost 2 years ago
v1.0
π¦πΊ
Australia
larowlan
almost 2 years ago
β¨
Add API to fetch data using destination plugins
Active
Code
Created
over 3 years ago
v1.0
π¦πΊ
Australia
acbramley
almost 2 years ago
β¨
Add KV destination plugin
Active
Code
Created
almost 3 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
π
Fix the issues reported by phpcs
Closed: won't fix
Code
Created
almost 2 years ago
v1.0
π΅π
Philippines
paraderojether
almost 2 years ago
π
Do not loop over the generator in Dataset::data() instead use the validate date iterator
Closed: duplicate
Code
Created
almost 2 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
π
Fix the queuing logic for indexing
Closed: duplicate
Code
Created
almost 2 years ago
v1.0
π¨π¦
Canada
jibran
almost 2 years ago
β¨
Allow field validation/transform on nested JSON values
Closed: won't fix
Code
Created
over 3 years ago
v1.0
π¦πΊ
Australia
tinny
almost 2 years ago
contrib
.social
Blog
FAQ
Discussions
Production build 0.71.5
2024