This release contains bug fixes
MDEXP-919 504 Gateway Timeout error when export deleted marc bib records from Member tenant on ECS Sprint testing environment
MDEXP-921 “Failed“ column is empty when export using Default linked data export job profile completes with errors or fails with not found records
This release contains LINKED_DATA support and other improvements and bug fixes
MDEXP-917 Not deleted suppressed from discovery and staff suppressed FOLIO Instance is not included in export all result with "deletedRecords": falseBug MDEXP-909 Exported ZIP archive contains files of incorrect type when export file size limit is setBug MDEXP-897 Not deleted MARC Instance shared from Member tenant is included in result of export all Instances from Member tenant as local, deletedBug MDEXP-896 Not deleted MARC Instance shared from Member tenant is included in result of export deleted MARC records from Member tenantBug MDEXP-888 ECS Holdings errors repeated twice on Error logs page when export Holdings in Central tenantBug MDEXP-816 Holdings Permanent and Temporary location not being exported when Temporary location is set in holdings recordBug MDEXP-812Inconsistent statistics in "Failed" column for 100K+ data export job Bug MDEXP-778 Review solution implemented in MDEXP-775 to address issues in ECS environment related to state "deleted"Bug
MDEXP-910 Upgrade the version of lib-linked-data-rdf4ld in mod-data-exportStory MDEXP-900 Enable Feign retry mechanic for FQM query clientStory MDEXP-894 Locking and unlocking mapping profileStory MDEXP-889 ECS - Resolve issue with Data export caching mechanism when locations are not presentStory MDEXP-886 Derive record type from mapping profile during export strategy selectionStory MDEXP-885 Export Linked Data as JSON-LinesStory MDEXP-884 Set export job filename suffix according to output formatStory MDEXP-882 Karate Tests: Linked Data exportStory MDEXP-875 Use multithreading for Linked Data exportStory MDEXP-874 Set Linked Data exported file suffixStory MDEXP-870 Adjust how record is identified as deletedStory MDEXP-868 Create a Linked Data converter componentStory MDEXP-866 Create Linked Data export strategyStory MDEXP-865 Integrate Linked Data provider with Linked Data export strategyStory MDEXP-864 Integrate query service into Linked Data strategy providerStory MDEXP-863 Create an FQM query serviceStory MDEXP-862 Create an FQM clientStory MDEXP-836 BE - Export authority records using CQLStory MDEXP-830 Spike - Remove data export dependency on instance_audit tableStory
MDEXP-907 Upgrade module to SpringBoot4.0 and Spring7.0Task MDEXP-903 Use GET /base-url to get FOLIO_HOST valueTask MDEXP-901 Add S3_SUB_PATH Environment Variable SupportTask MDEXP-899 Deleting mapping profilesTask MDEXP-898 Deleting job profilesTask MDEXP-895 Locking and unlocking job profileTask MDEXP-854 Create Application Descriptor Repository for app-data-exportTask MDEXP-852 Update for Split Search & Browse APIsTask MDEXP-850 Update to Support itemLevelCallNumberTypeId Constraint (Breaking Change)Task MDEXP-847 Add "Invalid CQL syntax" error for the case of export Authority record via file with .cql query Task MDEXP-839 Remove PLATFORM env var, drop Okapi codeTask MDEXP-835 Re-work all s3 related env vars and standardizationTask MDEXP-779 Tech Debt: enable check-style pluginTask
MDEXP-833 Remove openssh sshpass (sftp) from DockerfileTech Debt
This release contains only tech debts.
- MDEXP-833 Remove openssh sshpass (sftp) from Dockerfile
- Connection pool size improvements
This release contains bug fixes and dependencies upgrading together with migration to Java 21
- MDEXP-824 First Instance UUID record from .csv file with "UTF-8 with BOM" encoding is processed as error in Data export
- MDEXP-818 Upgrade deps fixing vulnerabilities for Ramsons
- MDEXP-817 Deleted authority export job profile is displayed for Export all authorities done without specifying profile id on Eureka environment
- MDEXP-805 Issues with errors "error.noAffiliation" and “error.instance.noPermission” when export Instances from Central tenant
- MDEXP-826 Update to mod-data-export Java 21
This release contains bug fixes
- EUREKA-529 Eureka | Export of a large file with 100K instances is stuck in progress in Data Export app
This release contains bug fixes
- MDEXP-815 Eureka | Quick export of MARC authority is done with wrong profile on bugfest non-ECS, ECS environment
This release contains dependency upgrades, bug fix
- MDEXP-806 Upgrade deps for Ramsons: Spring Boot 3.3.4, folio-spring-support 8.2.0, RMB 35.3.0
- MDEXP-811 Missing interface dependencies in module descriptor
- MDEXP-810 x-okapi-tenant header duplication
This release contains logic for permissions handling, improvement for export all, bug fixes
- MDEXP-802 Support Eureka permissions model for data export
- MDEXP-798 Authority download implementation as mrc file
- MDEXP-793 Export all - Set LDR05 to "d" for records set for deletion
- MDEXP-787 Export all - Combine "error.nonExisting.instance" and "error.deletedDuplicate.instance" errors
- MDEXP-785 Set LDR05 to "d" for records set for deletion
- MDEXP-783 Slow Queries when checking deleted records in tables mod_inventory_storage.audit_instance and mod_inventory_storage.audit_holdings_record for Data-Export-All
- MDEXP-770 Provide missing error messages and clean up existing errors for data export
- MDEXP-750 Create environment variable for volume to store files in mod-data-export
- MDEXP-742 Exclude fields from export records
- MDEXP-730 MARC Search Client
- MDEXP-726 Extend mapping profile schema
- MDEXP-695 Export Instances with Custom Export Profile from Central Tenant
- MDEXP-681 Ability to export deleted MARC authority records - support in ECS environment
- MDEXP-801 Upgrade "holdings-storage" to 8.0
- MDEXP-797 Update
source-storage-source-recordstov3.2and rename related module permission
- MDEXP-777 ECS | Export all Instances with Custom profile includes NoAffiliation error while User has affiliations with all tenants
- MDEXP-764 Export with the file containing mix of deleted and not deleted authorities ids stuck in Progress or executed for long time
- MDEXP-758 Deleted authority export job profile is absent on https://folio-testing-sprint-fs09000000.ci.folio.org/ environment
- MDEXP-757 Not all errors listed have details in error logs
- MDEXP-756 "Error.recordIsTooLong" error is not displayed on Error log page for Custom profile with SRS
- MDEXP-740 Export all - Number of duplicates reported in "Failed" column doesn't correspond with the number of duplicates on Error logs page
This release contains marking default authorities and deletion of error_logs where 'jobExecutionId' is empty
- MDEXP-753 Automate manual marking default authorities profiles as default
- MDEXP-752 Automate manual deletion of error_logs where 'jobExecutionId' = ''
This release contains aws-sdk and folio-s3-client versions upgrading
This release contains fixing for file saving
- MDEXP-746 Files larger 2Gb cannot be completely saved
This release contains minor improvements and bug fixes
- MDEXP-743 Unhandled error when id is missing in POST /file-definition request's payload
- MDEXP-739 mod-data-export documentation updating
- MDEXP-741 Data export should provide UnprocessableEntity response according karate scenarios
This release contains migration to Spring-based approach
- MDEXP-733 Adjust clean-up files timer
- MDEXP-731 Export gets stuck when no indicators in the rule
- MDEXP-725 Reference data is not included in export/fail export
- MDEXP-724 mod-data-export: spring upgrade
- MDEXP-723 Improve progress calculation statistic of data export for spring base module
- MDEXP-720 Clean job_executions_export_ids table after export for spring base module
- MDEXP-713 Provide accurate progress information on Export all jobs
- MDEXP-712 Implement the proper error message value
- MDEXP-711 Return list of the job profiles used in completed jobs
- MDEXP-690 Export MARC Instances with edited SRS
- MDEXP-689 NPE at the time of Mapping Profile and Job Profile update flow
- MDEXP-687 Data Export: enable async mode
- MDEXP-686 Add the ability to sort a number of fields in the data export
- MDEXP-685 Variable for Inventory record link in Error log should be reworked to avoid manual configuration.
- MDEXP-684 Avoid manual configuration for data-export
- MDEXP-677 Files upload flow rework
- MDEXP-644 mod-search usage to retrieve instances ids by cql
- MDEXP-642 Files Download: Rewrite/clean up existing and non-changed logic
- MDEXP-641 Quick-Export: Rewrite/clean up existing and non-changed logic
- MDEXP-640 Data-Export: Rewrite/clean up existing and non-changed logic
- MDEXP-634 Slicer component: configuration support
- MDEXP-631 Logs API, Transformation fields API: Rewrite/clean up existing and non-changed logic
- MDEXP-630 /data-export/export: Single File Processor
- MDEXP-629 /data-export/file-definitions/{id}/upload: upload refactoring
- MDEXP-628 /data-export/export: Holdings Strategy
- MDEXP-627 /data-export/export: Authority Strategy
- MDEXP-626 /data-export/export: Instances Strategy
- MDEXP-624 Create liqubase scripts for new DB objects described in the design confluence page
- MDEXP-623 Migrate RAML API definitions to OpenAPI definitions
- MDEXP-622 Create a project skeleton in a new branch.
- MDEXP-621 Export all endpoint
- MDEXP-110 Return list of users who run the completed jobs
This release includes only folio-s3-client upgrade
This release includes bug fix for failed jobs position in job executions view
- MDEXP-668 Regression: Failed jobs listed always on top of the queue when completeDate is missing
This release includes folio-s3-client update.
This release includes bug fixes.
- MDEXP-658 bump up folio-s3-client
This release includes bug fixes.
- MDEXP-660 Specify missing interface dependencies
- MDEXP-654 Missed details for user friendly error in data export log when multiple SRS records are linked to one instance
This release includes only bug fixes.
- MDEXP-659 Invalid values in export logs for some Failed exports
- MDEXP-658 Data Export fails/stops triggered by a large file (> 196K)
- MDEXP-653 "Failed" column is populated differently depending on the place in the file of record with duplicates
- MDEXP-557 "Failed" column is not populated on the "Logs" pane of Data Export
This release includes fix for migration scripts.
- MDEXP-625 Swap migration scripts
This release includes export of shared instances, authorities, updates for job execution schema, bug fixes.
- MDEXP-636 Add missing electronic access relationship values to default mapping rules
- MDEXP-617 Update to Java 17 mod-data-export
- MDEXP-614 SRS-client with "shared" MARC records support
- MDEXP-643 Migration scripts for adding user id to jobExecution schema
- MDEXP-639 Add "userId" field to "runBy" schema
- MDEXP-637 Export shared MARC authorities
- MDEXP-625 Report affected instance when export contains negative number of failed records
- MDEXP-602 Export shared MARC instances
- MDEXP-592 Update usage of jobExecution entity for quick export
- MDEXP-633 Inconsistent Data export results by Admin and User with data export permissions
- MDEXP-605 Empty files are not sorted by “Job profile” on the "View all" page
- MDEXP-598 Wrong CQL syntax in .cql fails export job without error message shown in the UI
- MDEXP-596 json-path 2.8.0
- MDEXP-588 Quick export: Job FAIL when all records was exported
This release includes bug fix for custom mapping profile
- MDEXP-584 Holdings cannot be exported with custom mapping profile
This release includes export and logging improvements
- MDEXP-581 Align MARC holdings record mappings between export and import mapping profiles
This release includes dependency updates
- MDEXP-561 Replace generate-marc-utils -SNAPSHOT by release
- MDEXP-560 Supports interface 'users' version 16.0
- MDEXP-558 mod-data-export: Upgrade RAML Module Builder
- MDEXP-564 Upgrade dependencies fixing vulnerabilities
This release includes migration scripts fix for mappings and job profiles
- MDEXP-543 Migration fails - mapping and job profiles
This release includes RMB v34 upgrade, export MARC authority records, default profiles implementation
- MDEXP-533 RMB v34 upgrade - Morning Glory 2022 R2 module release
- MDEXP-511 Migrate to use new api-lint and api-doc CI tools
- MDEXP-513 Support quickExport for Authorities IDs
- MDEXP-508 Spike: Export MARC authority records
- MDEXP-487 Spike: Limit file upload size
- MDEXP-213 Implement a way to identify default profiles (instances and holdings)
- MDEXP-519 Holdings export: subfields for 866, 867 and 868 are entered separately
This release includes build failure fix
- MDEXP-509 build-platform-complete-snapshot build failures 3/21
This release includes improvements of data export flow with custom profiles
- MDEXP-516 Preserve LDR 05, 06, 07 values on the export with custom mapping profiles
This release includes implemented export flow for holdings MFHD records and bug fixes
- MDEXP-477 Triggering the export with cql statement takes longer than expected
- MDEXP-505 Undefined permission 'data-export.mapping-profiles.collection.get , ...
- MDEXP-507 Invalid migration scripts for job profiles
This release includes implemented export flow for holdings MFHD records and bug fixes
- MDEXP-99 Generate MARC bib record additional fields if present -- array of strings to repeatable MARC field
- MDEXP-104 Generate MARC bib record - Alternate titles - conditionally replacing keys with values
- MDEXP-124 Generate MARC bib record - 500$a/notes
- MDEXP-303 Generate MFHD records on the fly
- MDEXP-432 Generate MARC bib record - Identifiers part IV - appending subfields
- MDEXP-433 Generate MARC bib record - Identifiers part V
- MDEXP-434 Generate MARC bib record - Identifiers part VI
- MDEXP-437 Create default mapping profile for holdings
- MDEXP-438 Create default job profile for holdings
- MDEXP-439 Rename Default job profile to Default instance export job profile
- MDEXP-499 Existing holdings UUIDs are reported as invalid while exporting holdings record
- MDEXP-504 Exported holdings MARC records are combined with the records generated on the fly
This release includes module configuration improvement
- MDEXP-455 Improve MinIO configuration process
This release includes bug fixes, code improvements, RMB upgrade, unexpected error handling.
- MDEXP-429 Update generate-marc-utils version to 1.2.0-SNAPSHOT
- MDEXP-422 Gracefully handle MARC records that exceed the size limit
- MDEXP-398 Improve code coverage on new code
- MDEXP-395 data-export- Upgrade to RMB 33
- MDEXP-394 Memory leaks in mod-data-export
- MDEXP-180 Implement using minio as gateway for AWS
- MDEXP-440 Reference data is missing when there are more than 200 entities.
- MDEXP-430 Leader Record status changes from "c" to "n" when exporting holdings and items data
- MDEXP-426 Escape control characters in quoted literals
- MDEXP-425 When a highly inefficient query is done, vertx main thread is blocked
- MDEXP-421 Export job triggered with invalid data stays in status New (and does not fail)
- MDEXP-409 DaoImpl: Use single id methods for get, delete, update
- MDEXP-402 Migration Script does not handle all cases
- MDEXP-400 Failed jobs listed always on top of the queue when completeDate is missing
This release includes the interface version bumping for SRS and mod-inventory related dependencies.
- MDEXP-403 align dependency versions affected by Inventory's Optimistic Locking
- MDEXP-407 Update srs interface version
- MDEXP-388 0% coverage reported by Sonarcloud for mod-data-export
- MDEXP-338 - Fix periodically wrong jobExecution state when uploading an empty file
This bugfix release includes fix for inconsistent results when holdings and items data incorrectly appended to the srs record in MARC file.
- MDEXP-385 - Holdings and items data incorrectly appended to the srs record
Major version release which includes below features :
- allow a user to append holdings and item data with MARC bib record when the user wants to export the record from SRS
- improve validation for mapping profile transformations: add general backend validation during saving; allow to pass transformations with empty value; allow characters in indicator fields
- improve error logs: reflect in error logs what record exactly leads to the exception during the export and append exactly the field name that causes the error; append a link to the inventory record if the export fails
- add a quick export feature: provide an endpoint to trigger the export based on a provided list of identifiers or CQL statement and can be used in triggering exports by external scripts
- add more Instance fields to append during generating MARC bib record on the fly: Invalid ISBN, Linking ISBN, Invalid ISSN, Cancelled GPO Item Number identifiers; other standard identifiers, publisher or distributor number, and canceled system control numbers
- add specific MARC for Holdings record fields mapping rules to map holdings data during generating MARC bib record on the fly
- add personal data disclosure form
- upgrade RMB to version 32.2.0
- MDEXP-265 - Applying mapping profile - holdings and item transformations provided - entire SRS record
- MDEXP-315 - Add validation to the transformation elements
- GMU-1 - Detect which record exactly leads to the exception during the export to the error logs
- MDEXP-262 - Create a link to the inventory record if the export fails
- MDEXP-285 - Provide endpoint for quick inventory instance export
- MDEXP-182 - Generate MARC bib record - Identifiers part II - conditionally replacing keys with values
- MDEXP-344 - Allow to pass transformations with empty transformation
- MDEXP-348 - Allow characters in indicator fields
- MDEXP-349 - Enhancements to /data-export/quick-export endpoint
- MDEXP-346 - The field name is missing if the reference name has changed
- MDEXP-12 - Create Inventory Holdings to MFHD record mapping rules
- MDEXP-353 - Upgrade to RMB 32
- MDEXP-191 - Generate MARC bib record - Identifiers part III - appending subfields
- MDEXP-358 - Add personal data disclosure form
- GMU-2 - Remove RMB and vertx dependencies
- MDEXP-372 - Update dependencies in data-export before Iris release
- MDEXP-318 - Missing error code for some error messages
- MDEXP-351 - Missing directory and data in leader when exporting holdings only records with custom mapping profile
- MDEXP-343 - Fix unstable StorageCleanupServiceImplTest
- MDEXP-347 - Holdings and items data is not appended to SRS entire record in custom mapping profile
- MDEXP-345 - Subfield $3 not always present when multiple holdings and items are associated with the instance
- MDEXP-360 - Most of data-export APIs returned unauthorized at all envs
- MDEXP-365 - Fix generated records on the fly for default profile
- MDEXP-367 - Provide granular error in the error log so that the same information is not repeated multiple times
- MDEXP-377 - Job completed with errors does not show how many records failed3
- MDEXP-310 - Delete file in S3
This is a bugfix release for fixing the wrong job execution state if upload an empty file, that breaks UI
- MDEXP-338 - Fix periodically wrong jobExecution state when uploading an empty file
This is a bugfix release for fixing the job execution status when invalid UUIDs are present in the batch
- MDEXP-337 - Fix wrong jobExecution status when some UUIDs are invalid or not found in storages not in last batch
This is a bugfix release for correcting SQL statement name in the migration script.
This hotfix release includes fixes to handle csv file with different symbols, handle empty csv file correctly, displaying UUIDs of records from inventory or SRS that were not found in error logs,fixed missing $ 3 subfield in MARC file and duplication of multiple error log entries. Also, this release includes migration script for mapping profiles.
- MDEXP-316 - Error logs does not contains items records if mapping process is failed
- MDEXP-314 - Mapping profile migrate fieldIds
- MDEXP-313 - Failed job associated with generated mrc file and contains multiple entries in the error log
- MDEXP-311 - Wrong job status when all UUIDs in the last batch not present in storages
- MDEXP-309 - When UUID is not found the error log doesn't list it
- MDEXP-308 - Subfield $3 is missing for the MARC tags with item data
- MDEXP-307 - Fix security dependency issue
- MDEXP-305 - Investigate if generated mrc files and directories are not being deleted
- MDEXP-267 - After uploading of empty file the progress field is not provided
- MDEXP-176 - Handle csv files with other characters
Major version release which includes below features :
- specify profile transformations for multiple fields from instance,holdings,items
- expire long running/stuck jobs
- ability to look at logs for each job-execution, and delete jobs
- exporting MARC records using a CQL query
- MDEXP-300 - Close ASW client after getting download link
- MDEXP-294 - Export records using CQL
- MDEXP-288 - Final verification migration scripts before release- Q32020
- MDEXP-282 - Observations on testing data-export with profile
- MDEXP-281 - POC: Export records using CQL
- MDEXP-277 - POC: Investigate making fewer calls to Inventory modules
- MDEXP-271 - Differentiate "displayNameKey" for entities without "referenceDataValue"
- MDEXP-270 - Review state control of module
- MDEXP-266 - Generate MARC record- Holdings and items in same field
- MDEXP-264 - API endpoints to follow naming conventions
- MDEXP-263 - API for DELETE /job-executions/{jobExecutionId}
- MDEXP-261 - Create API GET/data-export/logs for error log handling
- MDEXP-259 - Log errors for Holdings records export
- MDEXP-257 - Log errors for inventory Instance record exports
- MDEXP-256 - Modify status of the completed export job
- MDEXP-255 - Generate-marc-utils: add default support for translations
- MDEXP-252 - Applying mapping profile - location fields - holdings and item
- MDEXP-251 - Mapping profile - provide field name - locations - holdings and items
- MDEXP-249 - Applying mapping profile - Item - effective call number
- MDEXP-248 - Mapping profile - provide field name - item - effective call number
- MDEXP-246 - Implement Expire stuck jobs
- MDEXP-243 - Applying mapping profile - Combination of record types - selected fields - missing transformation
- MDEXP-238 - Applying mapping profile - Item - selected fields with transformation provided
- MDEXP-237 - Applying mapping profile - Holdings - selected fields with transformation provided
- MDEXP-236 - Check how much memory the module needs to get generated 1 file
- MDEXP-233 - Apply sorting for mapping transformations subfields in alphabetical order
- MDEXP-231 - Mapping profile - provide field name - holdings statement
- MDEXP-230 - Mapping profile - provide field name - notes (holdings and items)
- MDEXP-229 - Mapping profile - provide field name - electronic access
- MDEXP-227 - Mapping profile - provide field name - contributors
- MDEXP-225 - Restrict deletion of default mapping profile and job profile
- MDEXP-218 - Mapping profile - provide items field names - field value
- MDEXP-217 - Mapping profile - provide field name - value for key - with reference data
- MDEXP-216 - Mapping profile - provide holdings field names - field value
- MDEXP-211 - Mod-data-export migrate to Java 11
- MDEXP-210 - Mapping profile - provide instance field names - field value
- MDEXP-207 - Performance improvements
- MDEXP-174 - Use the created shared library
- MDEXP-150 - Mapping profile - transformations - retrieve field names
- MDEXP-141 - Applying mapping profile - Instance - selected fields with transformation provided
- MDEXP-90 - POC: Make data-export horizontally scalable
- MDEXP-75 - Create a Test suite
- MDEXP-306 - Fix migration script for handling statuses
- MDEXP-304 - Fix module logging after upgrade to java 11
- MDEXP-301 - Fix NPE while export with material type field for custom mapping profile
- MDEXP-279 - Mapping materialTypeId and permanentLoanTypeId to proper fields
- MDEXP-244 - Not all items displayed if mapped to the MARC subfield
This is a bugfix release to address changes missing metadata for default job profiles and mapping profiles
- MDEXP-253 - Default Profiles do not have metadata causing error screen
This is a bugfix release to address upgrade issues from v1.1.1 to current version because of the migration scripts
- MDEXP-247 - Data Migration issue on goldenrod
This bugfix release includes fixes to concurrency issues while exporting jobs and also fixes empty query sent to inventory which was causing un responsive module
- MDEXP-220 - Inconsistent results when exporting the same dataset with default mapping profile
- MDEXP-219 - Export job with custom mapping profile gets stuck when retrieving data from inventory
This release includes minor bug fixes related to job profile name and minor performance improvement for generating instances on the fly
- MDEXP-166 - Make records processing parallel
- MDEXP-214 - Incorrect indicators for Corporate and Meeting primary contributors
- MDEXP-208 - JobProfileName field not populating while getting job execution
- MDEXP-203 - Incorrect number of errors reported
The major change in this release is the interface dependency change to "source-storage-source-records" for performance reasons. Also other minor changes include jobprofile association with job execution and MARC field combining on Transformations
- MDEXP-199 - Update dependency on SRS v4.0.0
- MDEXP-194 - Provide information for UI about the job profile associated with the executed job
- MDEXP-193 - Mapping profile - combine subfields in one MARC field
- MDEXP-200 - GoldenRod upgrade issues on jobExecution table
- MDEXP-186 - Invalid fileDefinition returns success for /export
The major changes in this release include, generating MARC records on the fly for Instances, being able to define mapping profiles with transformations for holdings and items, and corresponding job profiles to trigger export job. There is also ability to transform existing MARC records on the fly by specifying transformations
- MDEXP-179 - Final verification migration scripts before release Q2 2020
- MDEXP-177 - Generate MARC bib record - 653$a/Subjects
- MDEXP-175 - Add user details in mapping profiles/job profiles
- MDEXP-172 - Job profile - create a default job profile
- MDEXP-171 - Use specified job profile in /export endpoint
- MDEXP-169 - Tenant level mapping rules
- MDEXP-165 - Mapping profile - transformations - traversing multiple holdings and items
- MDEXP-162 - Mapping profile - transformations - process holdings and items simple fields
- MDEXP-151 - Mapping profile - transformations - process holdings permanent/temporary locations
- MDEXP-143 - Create Mapping profile and Job profile schemas
- MDEXP-138 - Applying mapping profile - transformations are provided for all selected fields
- MDEXP-137 - Mapping profiles APIs
- MDEXP-136 - Generate MARC bib record - 008 fields
- MDEXP-135 - Create API test for data-export/export endpoint
- MDEXP-133 - Get the number of already processed records (successfully and failed) for a given job
- MDEXP-131 - Mapping profile - create default mapping profile
- MDEXP-126 - Generate MARC bib record - 300 field
- MDEXP-125 - Generate MARC bib record - 490$a/series
- MDEXP-123 - Generate MARC bib record - 264/publication data
- MDEXP-122 - Generate MARC bib record - 005 field
- MDEXP-115 - Rewrite unit test
- MDEXP-103 - Generate MARC bib record - Contributors - conditionally replacing keys with values
- MDEXP-102 - Generate MARC bib record - 655 $a/natureOfContentId - replacing keys with values
- MDEXP-98 - Generate MARC bib - Leader
- MDEXP-97 - Generate MARC bib record - Identifiers - conditionally replacing keys with values
- MDEXP-93 - Generate MARC bib record containing 001, 245$a and 999ff$i fields
- MDEXP-92 - Revisit naming convention of the file generated by export
- MDEXP-78 - Make /data-export/fileDefinitions/{{fileDefinitionId}}/upload idempotent
- MDEXP-77 - Refactor /data-export/export
- MDEXP-37 - RecordLoaderService: retrieve Inventory instance records without underlying SRS record
- MDEXP-189 - Export fails with NPE when dataOfPublication is null
- MDEXP-149 - Instances with underlying SRS should not have MARC bib generated on the fly
- MDEXP-148 - Incorrect record count for the records generated on the fly
- MDEXP-139 - Extended character set incorrectly encoded
This release contains a bugfix to the fromModuleVersion and start of sequence to 1
- MDEXP-118 - fromModuleVersion not updated
This release contains few bugfixes and also populates few fields that the required to be shown on the UI
- MDEXP-94 - Generated binary file is not removed
- MDEXP-91 - In large data exports - not all records are being exported
- MDEXP-95 - FT index not present
- MDEXP-80 - Provide Number of Records
- MDEXP-81 - Provide First name and Last name of the user who triggered the export job
- MDEXP-79 - Provide Human Readable JobId
- MDEXP-76 - NPE if none of the records are present in SRS
- MDEXP-74 - Add file extenstion valiation to /data-export/fileDefinitions and /data-export/fileDefinitions/{id}/upload
- MDEXP-71 - Tests covering end-end flow
Initial release, which exports MARC bibliographic records to AWS S3, for the instance UUIDs which have underlying records in SRS.
- [MDEXP-69] - Update a jobExecution entry in DB
- [MDEXP-68] - Create a S3 bucket for a tenant
- [MDEXP-67] - Export created file to S3
- [MDEXP-66] - Create API GET /data-export/jobExecutions/{jobId}/download/{fileId}
- [MDEXP-65] - Create APIs GET /data-export/jobExecutions to fetch all jobs
- [MDEXP-62] - Create project for API tests
- [MDEXP-61] - Create JobExecution entity
- [MDEXP-60] - POC: Saving files to S3
- [MDEXP-59] - Create PoC for the MappingProcessor
- [MDEXP-58] - Create InputDataManager
- [MDEXP-56] - File Export Storage Implementation
- [MDEXP-50] - Request to include mod-data-export to be deployed on reference environments
- [MDEXP-46] - SPIKE: Investigate saving generated export files
- [MDEXP-30] - Java technology stack
- [MDEXP-28] - Design Diagrams
- [MDEXP-27] - Requirements analysis
- [MDEXP-21] - SPIKE: evaluate the marc4j API for writer capabilities
- [MDEXP-20] - Project Setup
- [MDEXP-8] - Export instance records in MARC based on provided UUIDs
- [MDEXP-6] - Create Inventory Instance to MARC Bib record mapping rules
- [MDEXP-2] - Save binary MARC file in the designated location
- [MDEXP-1] - SPIKE: Investigate the way to read large csv files