Release Notes
Get details on new features, changes, and bug fixes for each Platform and toolkit release.
Release for 17-Dec-2024
Security patching of docker containers
Efficiency and bugfixes for writeable symlinks and object deletion process
Apps: gatk4_haplotypecaller_parallel v2.2.2 and gatk4_halotypecaller_rnaseq v1.0.2 are released to production
Release for 10-Dec-2024
Security patching for EC2 and docker containers
Titan Refactoring: fixes in the data catalog and dbcluster, and tuning of the symlink functionality
Apps: FastQC v4.0.2 is released to production
Release for 03-Dec-2024
Security patching
Refactoring to extend the internal management of secrets, upgrades to the worker to support the latest pyPI functionality and internal upgrades from node.js v18 to v20.
Apollo: addition of the locus_ids in the details field API
Release for 26-Nov-2024
Security patching for Docker containers
Updates to writeable symlinks - added functionality
User interface improvements with respect to tables, spend limits
Apollo: Fix for status reports on deeply nested directories in Azure
Release for 18-Nov-2024
Security patching of Docker containers
Added: BILLING_COMPUTE_COREHOURSURCHARGE_SKU and BILLING_COMPUTE_SPOT_INVOICING
Update field depdendencies, bugfix for the getdetailsdeate objects descriptors; updates to clone restrictions for writeable symlinks
Updates to the spending limits
App Update: sra_fastq_importer to v5.0.1, bowtie2_fast1_read_mapper to v2.1.0
Apollo: Minor fixes
Release for 05-Nov-2024
Security patching of docker containers and EC2 instances
Update of concurrency to drive services
Library updates to s3deleter, auditlog processing, api servers and download functions
Updates to the details in the user spend limits on the User Interface
Apps: locuszoom upgrade to v1.2.2, snpeff_annotate to v3.0.0, bowtie2_fasta_indexer updated to v2.1.0, hisat2_index to v2.0.1, hisat2_mapper to v2.0.1, jellyfuish_and_genomescape to v2.0.1, and strelka2_germline to v1.2.1
Apollo: new databaseResultsRestricted changes
Release for 22-Oct-2024
Security patching of docker containers
Updates to OIDC and writeable suymlinks
User Interface updates and fixes for URL redirects in httpsApps
App Releases: SVAL upgrade to 1.0.1
Apollo: Additional support somatic variant datasets
Release for 8-Oct-2024
Security patching of docker containers and EC2 instances
Efficiency enhancements via concurrent job event queues
Nvidia driver enhancements - additional drivers and ability to select the desired nvidia driver for their workers
App Releases: prsice2 v1.0.4 and raremetal2 v1.0.2
Apollo: Upgrade apps
Release for 01-Oct-2024
Security patches for Docker containers
GxP document cleanup
Titan bugfixes for for https-apps that truncated URLs and for https-apps that broke redirects
Update nvidia drivers in the workers
For appropriate subscribers upload and download functionality from writeable symlinks
App Releases: GATK BQSR (Parallel) v3.2.0, RSEM v0.3.3, FastQC v4.0, SVAL 1.0.0,
Apollo:
Security fix forbidding the use of '{' and '}' in restricted commands
Fix building of cohort query for pheno-somatic dataset linked by non-global primary key.
Release for 24-Sep-2024
No release for Titan or Apollo
Release of REGENIE apps (version 2.0.1)
Release of MultiQC app (v 2.3.0)
Release for 17-Sep-2024
Security patches for docker containers
Hardening of secrets management
Bugfixes on usage limits
User Interface upgrade to the React 18 framework
app-pling_gwas was upgraded to versionm 1.1.0
Apollo: upgrade of internal python to version 3.11 and accompanying libraries
Release for 10-Sep-2024
Security patches for docker containers and EC2 instances
Efficiency enhancements and fixes of the User Interface
The dxCompiler Docker image published to Docker Hub is deprecated and will be removed after November 1, 2024. As a replacement, there are instructions to build the image https://github.com/dnanexus/dxCompiler/pull/470
App app-plink_gwas upgraded to 1.1.0 including an upgrade to the supporting dxfuse functionality
Apollo: Security patching, fixes in the allele frequency for somatic variant assay in the genomic-range API.
Release for 27-Aug-2024
Fixes for data dependencies and User Interface bugs
Updated the Somatic Variant Assay Loader
Updated the app-snepeff_annotation application
Apollo: Fix of search in the system/findDatabases API
Release for 20-Aug-2024
Security patching for docker containers
Bugfixes for titan, including fixes to eliminate duplicate tokens and reporting project spending limits
Release of Picard CollectMultipleMetric v2.1.2, STAR Fusion Callere (v1.0.1), MQC update of internal binaries and a fix customer content bug
Apollo: Fixes for Oncoplot and fix for the search in database functionality
Release for 13-Aug-2024
Security patching for docker containers and EC2 instances
Bugfixes in Titan
Apollo: adding lollipop-plot for somatic variant analysis
Release of GATK4 BQSR (parallel) v3.1.0 to the tool library
Release for 06-Aug-2024
Security patching for docker containers
New internal functionality to support writeable symlinks
Removing some error message emails
Re-enabling remaining usage estimates (e.g. storage) on the org billing page
Apollo: Fixes to the somatic variant functionality, including the adition of new datasets
Release for 30-Jul-2024
Security patching for docker containers
Bug fixes for project rollup pages, writeable symlinks UI and other minor UI fixes
New functionality to allow finding external drives (for selective customers)
Apollo: Vizserver updates, hdfs filesystem updates across all regions containing Apollo
Release for 23-Jul-2024
Security patching for docker containers
node.js upgrade to the server and supporting libraries
Writeable symlinks are supported (behind a feature switch)
Bug fixes to address redis issues, OIDC fixes, and fixes to the monthly estimate calculations
Apollo: memory expansion of backend vizserver and thrift servers
Release for 16-Jul-2024
Security patching for docker containers
Fixes to auto-provisioning users and cloud manager
Release for 09-Jul-2024
Security patching for docker containers and EC2 instances
Fixes to dbcluster describe
Efficiency improvements on index caching and token-based authentications
CVE-2024-27322 patched on R-based apps; unpatched version is still present for existing pipelines.
Apollo: fixes to API counts in vizserver, additional ability to query somatic datasets
Release for 25-Jun-2024
Security patching for docker containers
Fixes for email notifications when approaching the spending limits
Efficiency enhancements for archiving
Somative variation applicable is now available (first phase)
Spot instances are available in Azure
Apollo: efficience enhancements in API calls
Release for 18-Jun-2024
Security patches for docker containers and NVIDIA drivers
UI changes to make the columns easier to read
Adding additional billing functionality
Apollo: additional code to check database access prior to queries
Release for 11-Jun-2024
Security patches for docker containers and EC2 instances
Fixes on project storage limits
Version upgrades for dxpy for NextFlow
Apollo: performance fixes
Release for 04-Jun-2024
Security patches for docker containers
Bug fixes and efficiency enhancements on archival services, enhancements to the metadata storage database and dbcluser accounting
Version upgrades to dxpy for new Nextflow pipelines
Azure spot instance enhancements
Apollo: query builder fixes
Release for 21-May-2024
Security patches for EC2 instances and docker containers
Updates to MySQL object to the latest version
Fixes to airlock functionality of the TRE, Azure spot functionality, and minor UI fixes
Apollo: Enhanced filter support for somatic variant data in the Cohort Browser
Release for 14-May-2024
Security patches for docker containers and EC2 instances
Added multiple functions to support write-able symlinks
Deprecated some SSO functionality that is no longer used
Refresh of CIS Level 2 hardening of Ubuntu instances
Fixes to the spending and storage limit functionality
Apollo: Fixes to project describe functionality pertaining to symlinks
Release for 07-May-2024
Security patches for docker containers
Bugfixes in Titan for DBCluster billing, project storage spend limit, JobID token
Apollo: Fixes to the file describe functionality
Release for 30-Apr-2024
Security patches for docker containers
Fixes for Titan egress events, UI. Added additional information in the error messages.
Apollo: Mnor fixes in the error messaging
Release for 23-Apr-2024
Security patching for Docker containersj
TRE: Fixes for withdrawals of data, withdrawal of data with watermarks and withdrawal enforcer
Performance improvements on lateral scaling of concurrency and spending limit enhancements
Apollo: Fixes with symlinks in Azure
Release for 16-Apr-2024
Patches for python and Java, patching of docker containers
User Interface modifications with respect to withdrawal functionality and execution lists
Apollo: bug fixes around syumlinks in Azure
Release for 09-Apr-2024
Patching of EC2 instances and Docker containers
Updates to the pricing model for dbcluster charges
Changes to the User Interface for monitor page
Cloud usage reporting, with project spend limits and notifications
Apollo: bugfixes
Release for 26-Mar-2024
Security patching for Docker containers
First component of writeable symlinks
Apollo: bugfixes file describe functionality and cleanup of abandoned symlinks
Release for 12-Mar-2024
Security patching for Docker containers and EC2 instances
UI fixes for the project change list
Apollo: fixes to the filecloser
Release for 05-Mar-2024
Security patching of Docker containers
Refactoring of API proxy and tokens
Added security.txt file
Apollo: updates to symlinks functionality.
Release for 27-Feb-2024
Security patching of Docker containers
Efficiency enhancements on the API proxy upload functions
Fixes to the search terms to accept odd characters
Apollo: symlink changes
Release on 13-Feb-2024
Security patching of Docker containers and EC2 instances
Fixes to dbcluster pricing and project spend limits
Updated dx-py version in workers
Apollo: No release
Release on 06-Feb-2024
Security patching of Docker containers
UI fixes when deleting > 10,000 files in a folder and the obscured "New Folder" in some menus
Fixes to user initiated withdrawals, fixes to watermarking, fixes of the email notificationb of spend limits, fixes to dbcluster billing, and fixes to project archiving when the project contains many files.
Apollo: Fixes in the Azure directories for Azure instances.
Release for 23-Jan-2024
Security patching of Docker containers and EC2 instances
Fixes billing for DBclusters
Efficient implementation on watermarking
Release for 9-Jan-2024
Security patching of Docker containers
Spending limit changes
Job Log forwarding (licenced customers only)
Apollo: Vizserver security patching
Release for 19-Dec-2023
Vulnerability patching of Docker containers and EC2 containers
Bugfixes APIproxy, containter cleanup, and project spending limit.
Implement the foundation code for user initiatived withdrawals.
Changes to increase efficiency of the watermarketing processes
Apollo: Security patching of SDKs
Release for 12-Dec-2023
Vulnerability patching for Docker containers
Fixes to the details execution page and fileviewers on the UI, fixes to the global workflow, fixes in the API proxy
Apollo: bugfixes calculation of the cohort allele frequency in the Cohort Browser for genomic data wihtout linking to primary pheno entity
Release for 05-Dec-2023
Vulnerability patching for Docker containers
Fixes to the user interfaces to allow fileview to work in all browsers (due to security changes within certain browsers)
Fixes and additional parallelization of data dispensal streams
Fixes to the details execution page in the user interface
Apollo: fixes to the data-clearcach on the vizserver API
Release for 28-Nov-2023
Security patching for Docker containers
"Look and feel" user interface changes on the execution details view
Titan: fixes to the 30-day worker limitation and fixes to the project spending limits
Release for 14-Nov-2023
Security patching for Docker containers, EC2 instances and patching minor versions of dependent libraries
Command line access to expression assay model for RNAseq and molecular expression data
Apollo: Updating the rounding algorithm in the Spark databases for increased scientific accuracy. This may impact the bins for the histogram of the Cohort Browser
Release for 07-Nov-2023
Security patching for Docker containers
Titan: fixes in data despensals, project spend limit enforcemen t and UI fixes in the workflow diagrams
Apollo: Fixes error messages arising from the vizserver API
Release for 31-Oct-2023
Security patching of Docker containers
Titan fixes to provider describe functions, fixes to the scalability of the dispenals microserver, fixes to the execution details display, fixes to the watermarking function and fixes to the metadata capacity lambda
Apollo Application: Somatic Variant UI - initial release of the user interface for the somatic Variant query/visualization app
Apollo: scaleability changes to enhance the responses for queries
Release for 24-Oct-2023
Vulnerability patching of Docker containers
Deprecation of the DNA_CLI_APP_RUN_DOCKER_CONTAINERS functionality
Watermark enhancements, UI cleanup, efficiency improvements, and correction of the spinning DNAnexus logo
Apollo: Enable search of a minimum of 2 characters (instead of 3) in the cohort browser
Release for 17-Oct-2023
Vulnerability patching of Docker instances and EC2 systems
Fine tuning of spend limit controls, fixes to project list folder displays
Apollo: expanding the scope of watrermarking, security patches, library upgrades
Release for 03-Oct-2023
Security patching of Docker containers for new vulnerabilities
Updating the security ciphers for nginx services
Bugfixes for project spend reporting, project relationship reporting, job reporting and projectrename folder issues
Apollo: Security upgrade of underlying open source libraries. Bugfixes for microservice code and regex for special character scanning.
Release for 25-Sep-2023
Security patching of EC2 instances and Docker containers for new vulnerabilities
Fixes of project spend limit reporting, access to restricted jobs, and fixes to storage accounting
Apollo: removal of deprecated security ciphers
Release for 12-Sep-2023
Security patching of Docker containers for new vulnerabilities
Fixes to the deletion queue services
Apollo: Vizserver fixes
Release for 29-Aug-2023
Vulnerability patching for Docker containers and lambdas
Expansion of the security ciphers for data in transit to includ 1.2 and 1.3
Titan: Fixes to project spending limit reporting, dbclusters
Apollo: upgrade to SQLAlchemy 1.4 and optimizations on the query builder for somatic variant analysis.
Release for 22-Aug-2023
Vulnerability patching for Docker containers and lambdas
Support for canonical transcript annotation
Efficiency optimization for the object deletion process, replacing open source code that is reaching end of life
Apollo: internal changes to support new internal digital signatures (Supply Chain related)
Release for 15-Aug-2023
Vulnerability patching for Docker containers
Disallowed executables will not disable any workflows containing these disallowed executables
Fixes in the UI for Tool Runner
Apollo: Performance enhancements for the Vizserver
Release for 08-Aug-2023
Vulnerability patching for Docker containers for new vulnerabilities
Fixes to long running jobs logs, refactoring logic for email arising from job notificiations and minor UI fixes
Release for 01-Aug-2023
Vulnerability patching for Docker containers for new vulnerabilities
Fixes for orphan projects, access to long running jobs, and minor UI fixes
Apollo: security patching of libraries
Release for 25-Jul-2023
Vulnerability patches for Docker containers for new vulnerabilities
Fixes to airlock, granular long job notifications, access to long running jobs, fixes to spending limit controls and fixes for the file closer lambda
Fixes to the Tool Runner UI for WDL workflows
Release for 18-Jul-2023
Patching known vulnerabilities in Docker containers and EC2 instances, workers, etc.
Fixeds to the authentication token deleter and enforcement of egress limits
Support for canonical transcripts, genomic data loading for somatic variants, CLI access for the somatic assay model. Project Level Usage Reports (limited release)
Apollo fixes for: updated generates SQL queries and other fixes.
Release for 11-Jul-2023
Patching known vulnerabilities in Docker containers
Batch runner and Tool Runner update on the web interface, resulting in a significant change in the UI and behavior
Updated worker toolkits
Project spend limitation reporting (licensed feature)
Bugfixes in org-admin notifications, Azure cloud manager and other bugfixes
Release for 27-Jun-2023
Patching known vulnerabilities in Docker containers for new vulnerabilities
Fixes to egress and compute charge reporting
Fixes to job restart functionality and long running job notifications
Apollo: fixes to enforce the 5 minute query timeouts
Release for 20-Jun-2023
Airlock functionality added for Trusted Research Environments (TREs)
Bug fixes to job restarts, project spend processes and fixes to the back button of the Community Portal
Increase the size of the job log from 2M to 4M
Security patches to Docker containers for new vulnerabilities
Apollo: minor bug fixes in the somatic variant functionality and error reporting
Release for 13-Jun-2023
Security patching of vulnerabilities on Docker containers and EC2 instances
Detailed job metrics (limited release through the balance of the year)
Apollo: bugfixes and infrastructure upgrades. Support for multi-assay support for Genetic Variant assays
Release for 06-Jun-2023
Security patching for Docker containers
Better error messaging for users authenticating via SSO
Project admins will be notified via email when their project has crossed thresholds of metadata capacity
Preserve intermediate job outputs to aid in error tracking
Fixes to job restart issues, better error mesages
Release for 23-May-2023
Security patching for Docker containers
Fix for Community UI - after 15 minute timeout, the user is correctly redirected to the Community login page
Apollo: Deprecate the apps association loader feature, extend the timeout for complext data fetches to 5 minutes
Release for 16-May-2023
Deprecate DNA_API_ORG-REPORT_HISTORICAL_CHARGES function
Security patching for Docker containers, lambdas and EC2 instances
Fixes to cloud manager and UI redirect issues
Apollo: support for large scale database operations (important for handling WGS data)
Release for 09-May-2023
Security patching Docker containers
Titan: fixes to known issues
Apollo: fixes to issues, such as internal ID, return timeout errors from long running data fetches to vizserver
Release for 25-Apr-2023
Security patching of Docker containers
Continuing the migration of the DNS to AWS' Route53, refactoring known issues
Apollo: fixes to the query builder
Release for 18-Apr-2023
Security patching of Docker containers and applications
Changes in the EBS swap volume with gp2 and SSD instances to fix known issues
Apollo: fixes to the vizserver to allow more database access
Release for 04-Apr-2023
Security patching of Docker containers
Ubuntu 22.04 AMIs available on both AWS and Azure execution planes
Apollo: upgrades to the Spark server and related package updates
Release for 28-Mar-2023
Deprecating Javascript monitoring
Security patching of Docker containers
Changes to the User Interface to become CWAG 2.0 AA compliant
Apollo: refactoring known issues, including large query handling by default
Release for 21-Mar-2023
Refactoring of the asynchronous archive services
Refactoring of the job re-use and support workflow (e.g., WDL)
Apollo: Refactoring of the geno filters for the command line interface
Release for 14-Mar-2023
Security patching for Docker and VMs
Refactoring of job restart, asyncrhonous archival and UI backend changes
Apollo: Spark server upgrades, Python upgrades
Release for 07-Mar-2023
Security patching on Docker containers and lambdas
Fixes for job preservation functionality
Release for 28-Feb-2023
Security patching for Docker container, lambdas and Ubuntu instances
Fixes to the Titan file uploader and cosmetic changes to the UI in the input components
Apollo: deprecation of the Association Browser
No Release for 21-Feb-2023
Release for 14-Feb-2023
Monthly security patching for Ubuntu instances, patching of vulnerabilities for Docker containers and AWS lambdas
Migration of platform service instances from Ubuntu 18.04 to 22.04 or 20.04 when not possible to fully migrate
UI fix to SSO users who are confronted with separate MFA prompt
Apollo: fix issues in dxfuse
Release for 07-Feb-2023
Granular wait time for spot instances for workflows (subscriber licensees only)
Docker container security patching
Refactoring of job refuse to support workflows (e.g., WDL)
Refactoring of known issues in Titan including s3deleter, spot granlarity issues, expansion of the metadata capacity in the describe API call, UI fixes to SSO users
Refactor of known issues in the initial login of the thrift cluster, more granularity in log reporting
Release for 31-Jan-2023
Patching of Docker container vulnerabilities
Titan: Fixes to the UI and s3deleter functionality
Apollo: fixes to enforcing region boundaries and API proxy issues
Release for 24-Jan-2023
Workflow Job Reuse will be deprecated completely, replaced with functionality elsewhere
Change GiB to GB e in the job disk comparison
Added new functionality to Titan, specifically:
DNA_API_PROVIDER_PERMISSION_RESTRICTIONS - Project/org restrictions should be enforced based on the provider constraint options choice
DNA_API_PROVIDER_DATA_CLONING_RESTRICTIONS - User is not able to clone data from restricted to unrestricted project or from restricted to restricted project with different studyID
DNA_API_PROVIDER_JOB_RESTRICTIONS - Restriction on building tools into the project from the user's computer or analyses
FastQC app (v2.2.3 and earlier) is deprecated
NextFlow - GA to a limited set of users
Added new functionality to Apollo, specifically:
TIP_DATA_ACCESS_PROJECT_RESTRICTIONS - The system can limit users access to data based on project settings and license
TIP_DATA_DISPENSAL - User is able to create project containing data specified by studyID
Release for 10-Jan-2023
New Titan Functionality
DNA_API_INTERNET_JOB_RESTRICTIONS - Data providers are able restrict the internet access for jobs running in Trusted Research Environment (TRE) projects in order to prevent egress of sensitive data from the TRE
DNA_API_EXTERNAL_UPLOAD_RESTRICTIONS - Project admin is able to restrict users ability to upload data into trusted research environment (TRE) projects outside of the jobs running in the TRE
DNA_GUI_EXTERNAL_UPLOAD_ACCESS_RESTRICTED - User is not able to upload files into the External Upload restricted project
DNA_GUI_EXTERNAL_UPLOAD_ALLOWED_FILE_UPLOAD - User is able to upload files into the External Upload allowed project
DNA_GUI_EXTERNAL_UPLOAD_PROJECT_SETTING - User can change External Upload Access setting
DNA_GUI_JUPYTERLAB_EXTERNAL_UPLOAD_RESTRICTED - External upload options are not available in JupyterLab job running over the External Upload restricted project
DNA_API_OFH_PROJECT_CREATE - User is able to create new project with data dispense or without data dispense option
DNA_GUI_OFH_PROJECT_CREATE - User is able to create new project with data dispense or without data dispense option
DNA_GUI_OFH_CREATE_ACCOUNT - User is able to create new account via OFH Landing page
DNA_GUI_OFH_USER_ASSOCIATION - User is able to make association of DNAnexus and AMS account
DNA_GUI_OFH_USER_2FA - User is prompted to set 2FA and it is not possible to remove it
DNA_GUI_OFH_USER_BILLING_INFO - User has XX GBP billing trial balance and default region is Azure OFH-TRE (London) after successful association
G5 GPU workers available in specific cloud
Apollo bug fixes: Fix for license and region checks
New Apollo Functionality
TIP_JOB_INTERNET_RESTRICTION - The system is able to restrict internet access in worker jobs
TIP_EXTERNAL_UPLOAD_RESTRICTIONS - Upload restricted projects have limited access
Titan bug fixes: Updates for the API server and Azure Cloud Manager. Fix of granularity for spot instances, fix of race condition for hard links updates; archival state fixes
Docker Container vulnerability patching
Release for 13-Dec-2022
DNAnexus is on AWS' Marketplace, so if you have AWS-issued credits, you can consume them via this mechanism!
Vulnerability patching of worker AMIs and Docker containers
Fixes to the external uploader restrictions, code cleanup
Apollo: Fixes to the Visualisation Server and API server. Cleanup of error messages
Release for 06-Dec-2022
Vulnerability remediation of Docker vulnerabilities
Completion of the annual SSL cert rotation
Apollo: fixes to the metastore, fixes to the clipboard functionality in the visualization module and other bugfixes
Release for 29-Nov-2022
Complete migration to new SSL certificates throughout the infrastructure
Bugfixes for billing, upload restrictions and SSO logins will no longer be redirected to the Project Page
Apollo: fixes to encryption of upload URLs in the API proxy and other minor fixes
Release for 15-Nov-2022
Security patching of the Titan User interface
Upgrading upload restrictions at the project level
Patching Docker containers to address new vulnerabilities
Apollo: updating SSL certs and refacting app interactions
Release for 08-Nov-2022
Docker security patching and hardening
User Interface security patching
Apollo: bugfixes, library updates, security patching
Release for 01-Nov-2022
Update OpenSSL v3 to 3.0.7 patch level
Patching Docker containers and CIS level 1 hardening
Fixes of known Titan issues
Apollo: bugfixes to known issues.
Release for 25-Oct-2022
Code optimization, bugfixes in the User Interface
Vulnerability patching for docker containers
Apollo: fix API proxy issues, regex fixes for routes and other fixes.
Release for 18-Oct-2022
Security patching of operating system and Docker containers
Additional Nextflow functionality added to Titan and Apollo
Release for 04-Oct-2022
Bugfixes to Titan and Apollo
Docker vulnerability patching
Release for 27-Sep-2022
Fix for 2FA prompt for existing SSO accounts
Fix for Jupyter Notebook calls
Fix to block archiving of object linked to applets
Vulnerability patching of Docker containers
Apollo: upgrades to the internal cache and related internal upgrades
Release for 20-Sep-2022
Filecloser, asynchronous archival function, and API proxy bug fixes
Internal upgrades of the metadata database
Apollo: fixes to the cohort browser and fixes to internal API routes
Release for 13-Sep-2022
End-to-end FIPS 140-2 validated ciphers within the FedRAMP boundary
Bugfixes to the authentication server
Apollo: bugfixes to known issues
Release for 23-Aug-2022
Hardening of routes behind the User Interface
Vulnerability patches to the Docker containers
Apollo: Additional granularity to the logging and billing. Cleanup of error messages.
Release for 16-Aug-2022
Added Monitoring and Restriction Controls regarding download and egress, ability to preview, IP addresses of users, etc.
Bug fixes on streams containing gzipped files
Apollo: Fixes to the 30K cohort browser encoding
Release for 09-Aug-2022
Complete migration to OpenSSL v3
New functionality to restrict IP domains for certain API calls
Updates to the NVIDIA drivers for GPU users
Increase the partition sizes for LXC
Security patching of Docker Containers
Apollo: Restrictions to downloads from Apollo
Release for 02-Aug-2022
Security patching for Docker Container vulnerabilities
Usage report fixes
Hardening of routes in the User Interface
Increases in timeout period for dxproxy
Apollo: enhanced CLI based querying, fixes to HDFS filesystem
Release for 26-Jul-2022
Upgrade the metadata database to Mongo 4.4
Upgrade node.js to v14
fixes to Archiving in AWS regions
Apollo: no release
Release for 19-Jul-2022
LXC filesystem limit increased
Monthly security patching
Upgrade for SSO users who switch accounts
Apollo: CLI based data querying
Release for 12-Jul-2022
Security patching of Docker containers
User Interface self-service billing functionality
Improved clinical data ingestion experience
Apollo: Refactoring of VizServer
Release for 28-Jun-2022
Fix of the "create" functionality of DBCluster (AWS deprecated previous engine on 25-Jun-2022)
Refactoring of user interface issues
Patching security vulnerabilities of EC2 and Docker containers
Refactoring issues of the cloud manager on Azure
Apollo: Enhance validations and experience around ingesting clinical data
Release for 14-Jun-2022
Internal refactoring of reported issues
End-to-End FIPS 140-2 validated encryption throughout Titan
Vulnerability patching of Docker containers
Apollo: refactoring user interface issues
Release for 07-Jun-2022
Vulnerability patching for images and Docker Containers
Titan new functionality: DNA_API_ORG_REPORT_HISTORICAL_CHARGES
Apollo new functionality:
TIP_VIZ_COHORT_COMBINE
TIP_APPS_COHORT_COMBINE_REBASE
DNA_GUI_COHORT_COMBINE
Apollo: fixes on Azure deployment; upgrades to the Spark engine.
Release for 23-May-2022
Updates to the internal CloudManager and fixes to microservices
Vulnerability patching of images and Docker containers
UI fixes
Release for 17-May-2022
Refactoring of multiple analyses workflows, more info on the spending limits and updates to the cookie notice
Security patching of the underlying operating systems and worker AMIs
Apollo: no release
Release for 10-May-2022
FIPS 140-2 encryption implemented for uploading/downloading from the storage plane
Apollo: no release
Release for 03-May-2022
Minor fixes and normal vulnerability patching of the User Interfaces and supporting libraries
Apollo: minor fixes, including the ability to query without a primary key
Release for 26-Apr-2022
Security updates for the infrastructure
Backend fixes to support upgrading the metadata database software version upgrades
Apollo: Enhancements of existing functionalities to ease the creation of mixing multiple cohorts
Release for 12-Apr-2022
Restrictions for SSH functionality
Refactoring of known issues related to container cleanup, caching, etc.
Apollo: Ability to export up to 200 columns in a table; UI fixes
Release for 05-Apr-2022
Tuning to optimize workflow runs
Updates to the documentation pages of the applications
UI fixes to show app versions in descending order, other minor UI fixes
Apollo: refactoring of known issues in the user interface
Release for 29-Mar-2022
Order pending jobs by rank
Node.js updates
Tuning of the thrift server throughput; facilitate the combination of cohorts in the cohort browser.
Release for 22-Mar-2022
Fixes to known issues, such as a fix to the scope of unarchiving to better control the scope, updated the internationalization library (fixes for text fields in the UI).
Apollo: Refactoring of issues with field mapping and support for ordered fields.
Release for 15-Mar-2022
Refactoring the User Interface to address issues, including moving the workflow input to the Project workflow pages.
Fixes to the unarchiving functionality, tighter control of scope of the unarchiving
Apollo: Refactoring of issues arising from the visualization APIs
Release for 08-Mar-2022
Refactoring known issues in the dbcluster, internal changes to FIPS 140-2 validated ciphers, Cloud Manager, fixes to the app updater when archive resources are involved, etc.
Updates to community portals - caching is now disabled
Apollo: Refactoring of the issue involving model input.
Release for 01-Mar-2022
Vulnerability patching of operating systems
Fixes to code compatibility to rush.js
Support ticket generation will be tagged with the Platform page of origin
Apollo: Enhanced support for bulk RNAseq data in a dataset
Apollo: Security and version number upgrades of servers
Apollo: Removal of autoloading a chart, so the user will be prompted to generate the chart
Release for 15-Feb-2022
Implemented FIPS 140-2 validated endpoints for archival functions
Bugfixes, such as issues reported in unarchiving function and email org_invite function
Updating reCaptcha functionality
Apollo: Added functionality to allow a user to incorporate Molecular Expression data into a dataset
Apollo: Fixes to issues in Thrift and VizServer.
Release for 08-Feb-2022
Update to Node.js v12 for the infrastructure
Backend updates to rush.js version in some of the lambdas, revising metadata sharding approach, updates to s3_deleter and minor bugfixes to the User Interface
Apollo: Address known bugs, including limiting the number of tiles in the dashboard to a maximum of 15
Release for 01-Feb-2022
Bug fixes on job restarts, rush.js updates and increased granularity of data in the audit trail
Apollo: in addition to bugfixes, the following functionality was added: TIP_APPS_CLINICAL_DATASET_MERGER - Users will be able to merge phenotypic datasets and TIP_APPS_ASSAY_DATASET_MERGER - Users will be able to merge an assay dataset and a phenotypic dataset
Release for 25-Jan-2022
Update of security patches of identified vulnerabilities
Spend limit enforcements
Enhancements for job filters
Updates to the email filters
Apollo: fixes to address solution-exception messages, fixes of the update API calls, and removal of blank pages in the User Interface
Release for 11-Jan-2022
Service Provider Single Sign On (SSO)
User Interface fixes
CloudManager enhancements (internal)
Apollo: updates and fixes of reported issues
Release for 14-Dec-2021
Fixes to Cloud Manager, visibility into the org license for the org-admins
Remove all Ubuntu 16.04 instances from production. Ubuntu 16.04 is available at the app level
UI fixes to the monitor pages; improve state transition with regard to Jupyter Notebooks
Apollo: refactoring known issues, such as nametags, etc.
Release for 07-Dec-2021
User Interface fixes to cancel transfers
Fixes for the initiation of nested workers and the API call for apprun worker limits
Monthly Security patches
Apollo: fixes for zero length files, security patches to packages and libraries
Release 30-Nov-2021
Button changes on the Web User Interface
Throttling renabled, refactoring of known issues
Release for 16-Nov-2021
Complete migration of the UI to React 17 with UI changes to the Data manager, removal of the Global Search button
Refactoring of known issues, such as fixes to watermarks, etc.
Release for 9-Nov-2021
Additional metrics for spinup and interval time for instances
User Interface infrastructure updates to React 17
Infrastructure consolidation for load balancing
Security patching
Apollo: refactoring of known issues
Release for 26-Oct-2021
Org Admin can view each org member's userID and email address
Refactoring minor bugs, including fixing timoues and fixes to allow additional flexibility for UKB dispensals
Apollo: Refactoring known issues
Release for 19-Oct-2021
UI fix to https workers
Refactoring of many reported UI issues
Refactoring of unarchive issues
Org Manager can access the org user's email addresses
Refactoring of the UKB rate card
Self-service billing for UKB RAP and PayGo customers only
Apollo: no release
Release for 05-Oct-2021
Monthly Security Patching
Deprecation of Global Search
Apollo: no release
Release for 28-Sep-2021
Refactoring of CloudManager
Additional heartbeat monitoring of the infrastructure
Refactoring of user interface issues
Apollo: Refactoring of known lissues and updating the version of tRNA to feed Apollo
Release for 21-Sep-2021
Changes to timeout on instance re-use
Updates to the billing daemons
Updates on data withdraw and refresh process
Moving infrastructure components to node.js v12
Apollo: Update of Spark to support v3.1.2 and fixes to database pointers
Apollo available in AWS-Frankfurt
Release for 14-Sep-2021
Additional logging for cluster jobs
Added additional time for reserve instances
Efficiency enhancements for listing projects
User Interface fixes to reported bugs
Chef upgrade on the infrastructure
Apollo: Deprecation of the legacy chort browser, efficiency enhancements of Spark and other fixes.
Release for 31-Aug-2021
Updates to Job Manager and Cloud Manager
Refactoring of issues on the User Interface
Apollo: refactoring of filter parameters, UI and Spark 3.x upgrades
Release for 24-Aug-2021
Audit logging updates
Refactoring of the User Interface issues
Sendgrid changes for event-based email notifications
Apollo: refactoring reported issues
Release for 17-Aug-2021
London region archiving
Refactoring of emall alerts
Code efficiencies pertaining to audit trail generation
Efficiencies added to the backend code to allow more efficient list of projects.
Apollo: refactoring known issues, efficiency enhancements and deprecation of the legacy Cohort browser
Release for 10-Aug-2021
Cloud Manager caching implemented in regions that use autoscaling
Refactoring of internal database to increase efficiency
Opening AWS region in London, will be visible on the user interface and rate cards in UK currency
Internal Splunk updated to v8.1.5
OpenJDK v11 updated on Ubuntu 18.04 AMIs
Apollo: No Release
Release for 03-Aug-2021
Switch to the Pannexin User Interface only
Data master fixes in the User Interface
Query optimizations
Internal migration of the org-specific audit logs to a more efficient process
Apollo: Refactoring of error messages, UI fixes to gene filter parsing an semiphore fixes for API calls
Release for 27-Jul-2021
Reset job fix
jQuery update
Master Daata UI fixes
lambda functions update
increase Cloud Manager Resilience
Apollo: Refactoring known inssues, including updates for code efficiencies and documentation
Release for 20-Jul-2021
Restart job fix
Internal update of jQuery to v3.6.0
Monthly vulnerability patching implemented in production
Apollo: Refactoring of known issues, including some minor refactor of UI for efficiencies
Release for 13-Jul-2021
Additions to ProjectDescribe API to include ranking field
Visualization tab of the User Interface will be migrated to the newer version (Pannexin)
Job Manager efficiences
Apollo: Added TIP_VIZ_COHORT_ANDOR, DNA_GUI_COHORT_ANDOR_JOIN_FILTER, and DNA_GUI_COHORT_ANDOR_FILTER_GROUP functionality
Release for 29-Jun-2021
Archive API updates
Platform refactoring: Fixes to the User Interface and error handling when project files do not exist
UUbuntu 12.04 and 14.04 instances will be deprecated. Workers using Ubuntu from 16.04 to 20.04 will continue to be supported.
Apollo: Refactoring of R functionality and fixes to license checks
Release for 22-Jun-2021
Updates to the billing page
Fix to the GetDetails call, handling of incorrect API calls and code efficiencies
Updating API servers to Ubuntu 18.04, security patching of infrastructure
Fixes to getFileStatusURL, verify all filter values in an array, fixes in the data picker, fixes in the histogram functionality
Release for 15-Jun-2021
Upgrade of the dependencies of the Auth Server
Titan bugfixes
Org Page UI changes
Apollo: UI fixes
Release for 08-Jun-2021
Refactoring for handling regions, fixes on cost limits, fixed prioritization and long-term fix for watermarking
Egress Reporting
Apollo: refactoring issues
Apollo: TABBY release - moving sections to multiple tabs
Release for 25-May-2021
Fixes on Rush.js project dependencies
Correction of defects in the JobManager and JobEvents
DBCluster updates to the latest TypeScript
React.js library upgrade, which may have slightly changes to the visual appearance as well as possibly behavior changes
Corrections to UserDescribe functionality
Fixes FileStatus calls, changes for efficiency of filesystem calls, tuning cache sizes
Release for 18-May-2021
Minor AMI changes for logging
Revert of egress accounting change and some watermark functionality
Additional information from file describe on watermarked files
Functionality to allow org-admins to share projects across orgs
dxcompile support for bash variables
Ubuntu 14.04 deprecated
Apollo: Fixing the total count number when multiple alleles are involved, performance enhancement on the underlying database access methods
Release for 11-May-2021
Job re-use with watermarking
Cloud Manager updates
Increase granularity in egress billing
Apollo: fixes of known issues, such as retry logic on read conditions and efficiency changes in the User Interface
Release for 04-May-2021
Updates to the DBcluster monitoring process
Re-deployment of dl-proxy modules to support ungraded infrastructure
Application context ID now included in the profiled projects, workers handle watermarked APIs, etc.
Implementing monthly vulnerability patching
Apollo: Fixes of known issues within Apollo, including data filter conditions and fixes to the Locus filter
Release for 27-Apr-2021
Refactoring of watermarking code to address issues
Refactoring of code performing bulk calls to reduce the volume of information returned
Updated the user experience (UI) with a new root component error page. Formerly, an error would show a blank screen when the worker crashed.
Implement Apollo on Azure West-US
Release for 20-Apr-2021
DBCluster services were updated to be more efficient.
Okta updates on dependencies
Fixes to the autoscaling of the Cloudmanager infrastructure
Fixes to the timestamps on expired/destroyed containers to integrate correctly in the metadata database
Expanded IP range on workers
PHI flag implemented on Azure
Implemented the 2FA authentication in the pannexin code (formerly only on the membrane UI code)
Apollo: Updates to the metadata connect functionality
Apollo: Fixes with the concurrency issues with API calls
Apollo: Efficiency updates to reduce the number of API calls
Release for 13-Apr-2021
Fix to allow UKB RAP users to download from multiple resources
Continued rollout of v6 to v12 upgrades to node.js in the APIproxy and CloudManager infrastructure
Updates to allow the cloud manager to handle tagged AMIs
Efficiency changes to the APIserver from the Monitor tab. UI fixes to the cohort browser where screen disappears and table crashes
All AMIs on AWS will be Ubuntu 18.04. AMI updates on Azure will come later. Older AMIs will continue to be supported
Apollo: Updates to the Vizserver to more efficiently use the API server and efficiencies implemented on the monitor badges.
Apollo: Resolved access issues to non-DNAnexus S3 buckets.
Apollo: Added DXDATA_CREATE_COHORT functionality to the product.
Release for 06-Apr-2021
Fix to userDescribe functionality
Fix to DBClusters
Okta SCIM update
Vulnerability patching
Refactoring of SSO token exchange
Apollo: Resolving issues accessing data in public S3 buckets, fixes for the data filters, and increased the efficiency of displaying tables in the User Interface
Release for 30-Mar-2021
Refactoring user describe functionality to provide greater visbility to the org-admin
Refactoring of minor User interface bugs
Apollo: Minor fixes to the filters
Release for 23-Mar-2021
Refactoring of the watermarking and UKB withdraws
Refactoring of User Interfaces, including multiple wildcard support
Apollo: refactoring of the Azure filesystem support and entity relationship filters
Release for 16-Mar-2021
Refactoring of functional issues related to: update job pricing, updating autoscaling of cloud manager, fixes to the event emitter components, updates to analysis describe to get increased mapping, increase org-admin ability to assign roles within their role, and efficiency fixes to the watermarking API calls.
Performance refactoring such as deletes on autothrottled instances, fixes of updates to update describe for field mapping to the User Interfaces as well as removing deprecated instances out of the code base.
User interface currency awareness
User interface capability to upload directly from S3 and Blob storage
Apollo: refactoring of issues arising from Azure filesystem
Release for 09-Mar-2021
Supporting GPU and high memory instances on Azure
Apollo: Now available on Azure (US-West)
Refactoring of Titan to fix hanging and uassigned cluster jobs, etc.
Updates to the dependencies of the Okta-SCIM servers
Bugfixes to projectDescribe
Expanding the ability to CLI ability to lower a job's priority to the UI
Apollo: fixes to configuration tables on Azure; when a configuration table is incomplete, it is no longer flagges as an error.
Release for 02-Mar-2021
Failed job restart fixes
Implemented the autoscaling Cloud Manager in the AWS-London region for UKB RAWP
Increased the granularity of reporting of Worker egress and access to heartbeat frequency
Restricted ability to change addBilltoRegion
File closer efficiency for files >1TB
New worker types in Azure
UI refractoring of bugs
Fix issues with orchestration scripting for running cluster jobs, bare SQL supported
Release for 23-Feb-2021
Cloud Manager on Azure updated for cluster jobs
Fixes on UI components to limit length of org-names, etc.
Apollo: Cosmetic fixes to Scatterplot and rerfactoring filters in the query builder. Added "is-not" filter condition
Release for 16-Feb-2021
Minor changes to org-design descriptor
Additional logging info for terminated spot jobs on AWS
Fixes to org-describe API to identify project calls for UKB RAP
Node.js updated to v12 for archiving
Apollo: Fixes to close database command and readfile cache. Added efficiencies for field selection UI activity
Release for 02-Feb-2021
User Interface fixes
Monthly security vulnerability patches, including the sudo vulnerability in Ubuntu
Updates to node.js v12 for Execserver
Apollo: fixes to vizserver and UI of cohort browser
Release for 26-Jan-2021
Additional enhancements to gather information from job fails to be captured in the audit log.
Graphic redesign of the download proxy (allow folders and multiple files (up to 100) to be downloaded)
Moving primary Authentication Server to Ubuntu 18.04
Apollo: R-based Apollo Dataset SDK
Apollo: Completion of filters
Apollo: User interface efficiencies
Release for 12-Jan-2021
Backend fixes to DBCluster
UI fixes to project transfer flow
UI vulnerability fix for PRSSI
Release for 05-Jan-2021
Monthly updates to address infrastructure vulnerabilities
Added one more access priv to HTTPS-worker (fix)
Limiting Customer Cloud Account to specific API calls, etc.
Backend changes to cloning files from the archive
UI fixes to datamanager
Apollo: refresh of apps on Apollo to address bugs
Release for 15-Dec-2020
UI refactoring to address 3.0 re-route issue and a fix to allow the batch input selection
Change to address email notifications when there are failed jobs. When massive (e.g. >thousand of more) fail from a workflow, email was sent for every job failure. This behavior will change to a limited set of emails focusing on the parent jobs only.
Health checks on the internal Cloud Manager
Transition of internal servers to node.js v12
UI changes in for UK BioBank users
Apollo: adding existential filter
Release for 08-Dec-2020
Updating Sendgrid emails (job status emails are processed via sendgrid)
Updating SSL credentials for 2021
UI fixes to allow the user to switch between cohort browsers
UI fix for the processing of long and complicated workflows/pipelines
Fix of job manager to accomodate detached jobs from appropriately licensed customers
Add access to Jupyter Notebook Previewer via the UI
Apollo: refactoring of the rsid filter
Apollo: Allow for version switch to support Apache Spark V3.0.1
Release for 01-Dec-2020
Fix for CanSeePrices to check the currency type (USD or GBP)
Fix of issues in the download proxy
Fix of the withdraw service for UK BioBank
Efficiency and performance enhancements for job re-use functionality
Update logic for price currency (USD and GBP)
Adding functionality: DNA_API_RDS_CREATE_DBCLUSTER, DNA_API_RDS_TERMINATE_DBCLUSTER, DNA_API_RDS_USE_DBCLUSTER for Titan
Jupyter Notebook file viewer
Apollo: Minor refactoring of the filters
Release for 16-Nov-2020
Employing a shared image gallery for workers in AWS and Azure.
Turn on autoscaling for the Cloud Manager in the AWS EU-West region only
Correction on measuring the runtime of cluster jobs
Refactoring of data dispensal issues
UI refactoring of Data Manager and Cohort browser to address issues
Rollout of the Ubuntu 18.04 operating system to the internal services of DNAnexus
Apollo: Refactoring reported issues with Apollo and documentation updates
Release for 10-Nov-2020
Refactor of worker job limits to allow user to continue launching jobs until their user limit is exhausted in orgs where they have not hit their limit.
Refactoring of association checker function
Exposed data egress monitoring performed by the worker (broken out from overall data egress)
Refactoring of issues of Cloud Manager on Azure spokes
Patching of infrastructure vulnerabilities
Updating the billing information to break out un-archiving charges from the archiving charges
Apollo: refactoring issues
Release for 03-Nov-2020
Add currency field to the job_analysis_describe command
Initial fixes for the File Viewer for the Safari viewer (MacOS native browser)
Refactoring of the Cloud Manager log reporting into the SIEM (more information) and log rotation on the Cloud Managers
Apollo: Refactoring reported issues with Apollo, including file status cache issues resolved, fixes to the helper method for exploding columns, etc.
Release for 27-Oct-2020
Job Manager and Cloud Manager autoscaling
Detached Job functionality added
Guard rail on number of objects to limit to less than 100,000 objects per command
User Interface fixes to the login redirect URL
Efficiencies for data dispensal application
Apollo: refactoring reported issues
Tools: Original Quality Functionality Equivalent app released - see: https://platform.dnanexus.com/app/oqfe
Release for 20-Oct-2020
Refactoring of the Cloud Manager for efficiency and resolution of issues
Refactoring for more efficient communication between the Job Manager and the internal API Server
Make default the view of the archive data usage.
Enable logging of API functions that call other API calls (e.g. API_1 --> API_2 --> API_3)
User Interface Refactoring cleanup
Apollo: Refactoring of reported issues, such as fixes when multiple spark clusters are using the same file, etc.
Release for 13-Oct-2020
Refactoring of user describe functionality, lambda updates for performance, fixes to RegionIPRegions to map from the spokes to the user's IP space and improved efficiency of the archive state check functionality
User interface performance fixes - specifically in the data manager
Security vulnerabilities for infrastructure were patched
node.js upgrades in the infrastructure
Apollo: fixes to the scatter plot and dates of the histogram functionality. Fixes to parsing large files (> 2G).
Release for 06-Oct-2020
Additional tuning of the Cloud manager for autoscaling
Minor refactoring of "find" API call to return all possible items
Data manager in the user interface will continue to show the size of the objects, but the size will no longer show the size of all related objects
Ubuntu 20.04 is available for workers in all clouds (AWS and Azure) in all regions.
Internal instances of nginx are upgraded to version 1.18
Apollo: Additional refactoring to address issues with the cohort browser, version changes in dxdata, and entity support for boxplot
Release for 22-Sep-2020
Additional tuning of the Cloud manager for autoscaling
Internal refactoring to expand the user describe functionality for spot instances, kill-switch when jobs hit their pricing limitations, and additional reporting from the API servers
Internal nginx servers upgraded to 1.18
Apollo: additional refactoring to the cohort browser
Release for 15-Sep-2020
Update of cloud Manager for autoscaling
User Interface refactoring of known issues
Apollo: Refactoring of locus controls, genomic range controls and decimals in the histogram
Release for 01-Sep-2020
Refactor cloudmanager for VPC changes
Refactoring of the operation of cluster computing in workflows
Apollo: fixes to handling netstat error. Refactorig of the cluster packages and use of the appropriate signatures in Apollo components.
Apollo: go live of Apollo in the London cloud for select customers.
Release for 25-Aug-2020
Refactoring links between the Job Manager and API server
Added DNA_API_PROVDER_DESCRIBE functionality to the Platform
Addition of AWS-London cloud to DNAnexus environment for specific customers
Vulnerability patching of the DNAnexus cloud infrastructure
Apollo: Refactoring of V3 of data/time and max/min range of the histogram. Added boxplot explod functionality for hierarchical and multicolumn selections
Release for 18-Aug-2020
Refactoring of the autoscaling within the Platform
User Interface refactoring (restoration of breakcrumbs in the data manager and highlighting)
Apollo: upgrade of the VisZerver to the V3 distribution
Release for 11-Aug-2020
Cloud Manager refactoring
Updates to Grub2 and other security fixes
Upgrades to Docker containers/pilot
Apollo: backend changes to Histogram, ScatterPlot and descriptor functionality
Release for 04-Aug-2020
Updates to internal servers - API Servers to Ubuntu 20.04
Refactoring of database cluster in the infrastructure
Refactoring of the project describe functionality to address issues
Okta-SCIM updates (SSO for customers)
Apollo: internal code to perform additional data payload verification tests, cohort code refactoring and updating dx-data in Docker.
Release for 28-Jul-2020
User Interface Refactoring, including adding users to org by email, fixes to password complexity, UI footer style checks and a fix for a race condition occasionally seen when selecting folders.
Cloud Manager refactoring
Proxy Lock refactoring for the China region only.
OktaSCIM changes
Release for 21-Jul-2020
Updates to the external SSO - Okta SCIM
Fix for the SQS SendMessage batch message length to allow for larger messages
User Association Page
Apollo testing framework update
Release for 14-Jul-2020
Refactoring known user interface issues, fixes to data manager
Routine updates of NVIDIA drivers for the AMI instances that use GPUs (includes security update)
Fixed occasional bugs in upload proxy; fixes to detached job issues
Apollo: Refactoring of code to support V3
Release for 07-Jul-2020
Enhancements for internal robustness of the https-worker client
User interface refactoring, including changing the load spinner to reflect current brand colors
Apollo: align ownership of internal files for smoother processing, updating panda and internal query routes. Updates on v3 of the updater and data loader.
Release for 30-Jun-2020
Fix for jobeventsconsumer code for old objects
Completed fix for JobManager API calls
Update to https-workder to allow custom names
Apollo: dxdata refactoring and added compatibility check when uploading data
Release for 23-Jun-2020
Refactoring of the internal platform message queue to decrease the number of calls from the redis server.
Increase platform robustness by refactoring the jobEventQueue and Standard Queue
User Interface refacotring in the data manager
Apollo: Refactoring cluster log collection and arguments of the vizserver API. Fixes in the backend components to support the allele frequency functionality.
Release for 16-Jun-2020
UI refactoring ("pannexin"), including deprecation of unused code, fix for missing file size in file preview for image/pdf, refactoring of the data manager and fix of the range filterin in GWAS Manhattan dataset.
Added government required links regarding contacts and abuse to the China cloud of DNAnexus.
Refactoring of log rotation within the Platform
Apollo: Changes of the vizserver to support the new software versi0ons in the backend, API refactoring and collection of logs in the Spark cluster.
Release for 9-Jun-2020
Minor bugfixes in the Platform, such as resolving symlinks, etc.
User Interface switch between the legacy UI "Membrane" and newer UI "Pannexin"
Disable public user from executing a user-describe functionality (security enhancement)
FedRAMP email channel through Salesforce is activated
Common password rejection
Apollo: refactoring of API design, update error messages, date & time fixes, and upgrade to the HAR files
Release for 19-May-2020
Refactoring Cohort Comparison Browser
Move the legacy authentication server to Python 3
Security fix for stylesheets
Release Notes for 05-May-2020
Updates to the Okta SCIM SSO server
Refactoring of the nginx web server on the worker AMIs to resolve existing issues
Apollo: refactoring geno cohort filter
Release Notes for 28-Apr-2020
Cookie notice will appear in compliance with EU requirements
Minor fixes to node.js installers and packaging (internal)
Refactoring of existing Cloudmanager to increase the monitoring scope
Apollo: Added DNA_GUI_SURVIVAL_PLOT functionality in the cohort browser. Added support on Azure for the Thrift server integration from VizServer
Release Notes for 21-Apr-2020
Refactoring of Cohort browser and Companion browser, including max/min labels on charts, color changes in some icons
Infrastructure refactoring to node.js installers and packaging.
Release Notes for 14-Apr-2020
Internal refactoring of the Azure Cloud Manager to handle docker containers
UI refactoring for project list, set bill-to components, and cohort browser/comparison
Apollo: added DNA_GUI_COHORTCOMPARE_LOAD functionality
Release Notes for 07-Apr-2020
Upgrade internal platform to Mongo 3.6 (in compatibility mode)
UI changes to Manhattan plot zooming and refactoring of Cohort Browser/comparisons
Apollo: Added TIP_APPS_PLATO_GWAS functionality
Release Notes for 31-Mar-2020
New Lambda function for internal autoscaling
Storage accounting updater daemon added (internal only)
Upgrade the internal version of Python from 2.7 to 3.x
Release Notes for 24-Mar-2020
Refactoring Pannexin User Interface (e.g. fixing zeros that showed up in preview, but held values)
Update Okta-SCIM infrastructure
Refactoring cohort browser
Release Notes for 17-Mar-2020
Upgrades and refactoring of the Cloudmanager on the Platform
Refactoring to existing cohort browser (e.g. list, nodeSearch and cohort comparison paging)
Apollo: minor refactoring to address issues in the backend.
Release Notes for 10-Mar-2020
Refactoring to existing cohort browser
Security patches to the user interface
Added the following functionality: DNA_GUI_DM_ELEMENT_CHECK, DNA_GUI_DM_NAVIGATION, DNA_GUI_SIDEBAR_OPEN, DNA_GUI_DM_INFO_TOGGLE, DNA_GUI_CUSTOMIZE_COLUMNS, DNA_GUI_FILTER_FIELDS, DNA_GUI_DM_CLEAR_FILTERS, DNA_GUI_DM_LOAD, DNA_GUI_DM_CREATE_NEW_FOLDER, DNA_GUI_DM_CREATE_NEW_WORKFLOW, DNA_GUI_DM_UPLOAD_FILE, DNA_GUI_DM_COPY_FROM_PROJECT, DNA_GUI_DM_START_ANALYSIS, DNA_GUI_DM_DEFAULT_ACTIONS
Apollo: Added the following functionality: DNA_GUI_REMOVE_ALL_TILES
Release Notes for 03-Mar-2020
Self-service archiving on Azure
Python 3 rollout in Platform infrastructure
Apollo: refactoring of existing code
Release for 25-Feb-2020
Platform - refactoring of known issues
Apollo: additional data loader functionality
Release for 11-Feb-2020
Minor refactoring on the Platform and infrastructure for Azure and AWS clouds
Apollo: minor refactoring of outstanding bugs in Vizserver
Release for 28-Jan-2020
Upgrade internally to Ubuntu 16.04 (from Ubuntu 14.04)
Refactoring of Apollo - minor bugfixes
Release for 14-Jan-2020
Job Manager changes to allow Job Manager to talk to internal API servers via tokens
Cluster job failure resolution - if there are multiple failures, will quit
Refactoring of cohort browser at the UI level
Apollo: Update to Python 3.7 in the backend
Release for 07-Jan-2020
Refactoring s3deleter code
Refactoring internal billing code
Cloud Manager changes to support GPU instance types
Pricing code changes for multi-region AWS archiving
Apollo: Refactoring histogram functionality
Apollo: Implementation across Azure (not just AWS)
Release for 17-Dec-2019
Refactoring of archive modal iconf, data catalog page presentation fixes, UI efficiency improvements, add support for number format for 'e(+/-)', fix for the medusa update, data limits message clarified, documented tile requirements, fix cohort browser UI to allow dashboardConfig without any geno data components, fix filter pills overflow, remove usage of limits for charts from fieldsJSON and parallelize jenkins tasks.
Selective release of new functionality to support relational databases
Apollo: Minor refactoring of sorting file parts before joining, link datasort from selected cohorts, set reverse DNS lookup to false, store genoBins in cohort details and update specific multi-part upload configs on Azure
Release for 10-Dec-2019
Replace old DNAnexus logo on error pages
Remove old archival code
Apollo: refactoring binBy histogram code, license check code, and tipsync feature
Release for 03-Dec-2019
Additional instances types added for DB Cluster
File archiving in China
UI changes
File archiving refactoring
Apollo: filter options
Apollo: Looker sunset
Release for 05-Nov-2019
Refactoring User Interface to include SSL headers
Pages listing org-admins moved to the Pannexin user interface
Enable GPU instances in China cloud
Refactoring of the DB Cluster code
Refactoring of the file archiving code
Apollo: Minor refactoring of code and documentation
Release for 29-Oct-2019
Extended refactoring of file archiving in areas such as timeouts, increased efficiencies, etc.
Add license checks to ensure files can be downloaded
Refactoring of the cohort browser user interface.
Horizontally scaling CloudManager to handle more concurrent workers by sharding within each instance type.
Release of autoscaling of the authorization server to allow for high availability as the usage increases
Apollo: Refactoring of select queries, trimming of caches, etc.
Release for 22-Oct-2019
Refactoring of billing code with respect to file archiving (internal functionality)
Additional code to ensure the filenames of files to be archived have not already been archived
Apollo: refactoring of Basic 2 variable charts
Release for 08-Oct-2019
Refactoring self-service archiving, including the user interface and checks to make sure the files to be archived have not been deleted since the archiving process started
Refactoring the CloudManager on AWS to handle more concurrent workers (via load balancers)
User Interface refactoring in Pannexin for the cohort browser and customer-specific browsers
Apollo: minor refactoring for database support on Azure.
Release for 01-Oct-2019
Refactoring of the backend systems supporting Titan, including bugfixes for improvements, customer-specific user interface encements
Apollo: Additional code buildout for local processing on Azure clouds, removal of code to access Looker (deprecated visualization module).
Release for 24-Sep-2019
Refactoring of the user interface for improvements, customers-specific user interfaces.
Apollo: code buildout for local processing on Azure clouds, improvements in the cohort browser
Release for 17-Sep-2019
User Interface changes, including the overall look and feel, ain project folders and data selector.
Refactoring in Titan, including refactoring Mongo queries, additional internal error messages, etc.
Refactoring in Apollo around documentation and Mongo queries
Release for 10-Sep-2019
Add authentication token and labels at the end of the human readable audit trail
Change and add new instance clases (c.3.xlarge becomes c5.xlarge; new instance c5.9xlarge)
Horizontal scaling of CloudManager to handle more concurrent workers (AWS only)
Apollo: Minor refactoring of code supporting the viz server, API servers for list of folders and dxdownload support
Release for 27-Aug-2019
Minor changes to the Platform U(ser) I(nterface) to support the use of the visualization server in Apollo
Backend ability to push object to the archive (AWS only)
Apollo: Minor changes to the vizserver (visualization server)
Release for 20-Aug-2019
Refactoring dbcluster - fix where dbcluster gets stuck in "creating fix" step
HITRUST certification received
Feature switches - internally focused on billing
Audit Log filenames - only for customers with "human readable" audit logs, files will have a prefix of YYMMDD to allow natural collation
Apollo - revisions to cohort browser to enable multi-cohort charts
Apollo - integrate additional variant annotation sources
Release for 13-Aug-2019
Refactoring dbcluster code
Refactoring of job manager user interface - should be faster
Cleanup of the backend (not accessible to users) for Chart Builder, including support for importing CSV files
Apollo: Cleanup and removal of mapping of Spark (full transfer to Spark 2.2)
Release for 09-Jul-2019
User Interface - removing featured projects when there are no projects
Refactoring internal docker code
Refactoring internal dbcluster code
Apollo: batching filesystem deletes
Release for 25-Jun-2019
Refactoring of memory lead issues related to file closers
Refactoring of user interface for samples management
Moving wiki links hardcoded into the UI to the documentation.dnanexus.com site
Apollo: SQS queuing for vizsync service
Apollo: users can add multi-variate charts to the cohort browser
Release for 18-Jun-2019
Apollo: Extending API Service module to obtain the SQL query from the Visualization Server
Apollo: Refactoring of occasional 404 error from the Thrift Server
Add DBCusterStart (relational database functionality) in CloudWatch
Refactoring to correct asserion error when using findDataObjects when using SortBy filed.
Expanded damemon to abandoned deleted files from a maximum of 1024 files to unlimited, after initial warning
Refactoring race conditions in jobs finding files in workstation.
Refactoring code for the community selector when the user has no communities
Migrating Jenkins nucleus jobs from Ubuntu 14.04 to 16.04
Downloading is stopped if the customer's account is out of money
Release for 11-Jun-2019
Apollo Refactoring: Disable functions that are no longer used (e.g. reload function and getFunctions)
Apollo Refactoring: Fix dataset sync for visualization between the API server and visualization serve
Apollo Refactoring: Log the start/end time between API calls
Apollo Refactoring: Fix the project feature access check
Move lambda functions from node 6.10 (end of life) to 10.x
Remove project file closer locking as this is no longer necessary
Move lambda functions from node 6.10 (end of life) to 10.x
Add archival billing events to stream to the billing apps
Modify community login and registration pages to current branding as well as hidRegistration option
Fix the page loading of Internet Explorer 11 (11.1087.16299.0) as well as an older version of IE (11.0.9600.1784.eIS)
Release for 03-Jun-2019
Apollo - Code to support sharding of relational databases. Default will be "off"
Apollo - SQL fixes to Looker
Apollo - Removing default of using vizservr as the default visualization service. User will need to specify visualization server
Refactoring header authorization in the user interface
Refactoring the code supporting community links on the Platform user interface
Update dx-toolkit to 0.281.0
Fix the internal tagging of the docker images on the Platform
Release for 20-May-2019
Minor revisions to the navigation bar in the header
Internal replacement of the MongoDB sotrage system from MMAP technology to WiredTiger technology
Refactoring of unarchive functionality
Slight styles changes to the navigation bar (no changes to the functionaly). User interface will move to v4 of WebPack.
Apollo - bring your own database (BYOD) to now include JDBC drivers for Postgres, msSQL, MariaDB, MySQL, Amazon Redshift and Oracle
Apollo - security update for Looker
Release for 14-May-2019
Slight changes to the Platform toolbar
Okta SSO account migration
Refactoring costing model for the arcidAT command
Refactoring of archive
Create docker service skeleton
Apollo move throttle to the server
Release for 07-May-2019
Refactoring of workiner execution for slow jobs
Refactoring of nucleus issues (fix of eventconsumer logging defect)
Cohort Browser is move to the standard Platform interface
Apollo refactoring to return runtime file-ID from dashboards for saving cohorts
Apollo Looker security update from v5.16.13 to v6.8.27 (latest)
Refactoring LXC address documented change from LXC 2.0.8 to LXC 2.0.11
Added larger instance type c5d.9xlarge
Fixed NVIDIA driver load for p3.2xlarge instances
Release for 30-Apr-2019
Clean up execserver code to address log truncation
Enable /dev /tmpfs setup and clean up LXC
Add archivedAt timestamp during the CloudArchival process
Apollo - pooling http client connectiopns for APIserver calls
Apollo - refactor connection pool configurations for APIserver client on thrift and metastore
Pannexin Tool Library Changes: improvements to the Tools Library, new user experience for the Tool Library whereby the information in /apps will be contained /panx/tools. /apps will go away; Tools Library now includes Global Workflows; Apps and Global Workflows launched through Tools Library will load in the new Tool Runner by default.
Enable trusted org-admins to lock/unlock, reset MFA for their org users.
Release for 23-Apr-2019
Web user interface can now run global workflows
Additional fixes to DBCluster
Provide a public IP address per worker on the Azure environment
Port of Jobmanager to a docker build base, which is based on Alpine
Upgrade Docker to 18.09.5. Simplify docker install
Separate the license from Jupyter Lab from Apollo so they can be licensed separately
Refactoring of code for the cloud archival containers
Release for 16-Apr-2019
Integrate JupyterLab into the menu functionality of the web interface for the Platform
Increase Node.js memory limit for the job log archiver service.
Implement a container function to manage the archive process.
Refactoring of Apollo code to address issues
Release for 09-Apr-2019
Refactoring of findProject API call
Support loading and interactive querying of full whole exome samples in Apollo
Unique ID of the Thrift Server used written to the audit log (Apollo)
Support for single node spark clustger (instead of requiring a minumum of 2 nodes; Apollo)
Updating the DNAnexus logos to new branding, primarily on CSS sheets of web pages
Detect and report worker filesystem errors in the worker log file
Refactoring of code to make sure archiving does not include symlinks
fix for datbase sort memory limit with findProject memory limitation
Release for 02-Apr-2019
File leve archive for API and CLI support to archive and unarchive files, folders and projects
Fix to completely delete the files in scope on Auzre
Fixes for the internal dbCluster database files
Pooling fo services on Apollo so that small jobs doe not get caught behind large jobs.
Tuning of Prometheus sensing software
Release for 26-Mar-2019
Apollo refactoring of reconnection, fix for ORC file formats and fix to make sure the error messages are correct.
Platform to restrict the running ot HTTPS apps
Platform to upgrade NVIDIA driver on relevant workers
Drone moved to the same VPC as Artifactory (no functionality change)
Implement new billing eents database
fixes to bill for file archiving
Release for 05-Mar-2019
Refactoring of the MongoDB timeout parameters
Removing obsolete job group logging code from Apollo
Refactoring of filter in the getUSER api call
Release for 26-Feb-2019
Refactoring the m3.medium ephemeral disk space issue
fixing learna for archiving common packages
Updating the unarchived API logic
adding autoscape hosts to perform platform_pilot_status
Release for 05-Feb-2019
Adding internal metrics and alerts to the internal audit trails from the Platform.
Refactoring the error handling in the MongoDB for metadata storage
Phase out usage of describeSpotInstanceRequests as this is no longer being used
Release for 28-Jan-2019
Refactor internal account for cluster jobs
Refactor the file status caching logic for Apollo
Release for 21-Jan-2019
Refactor internal authentication server
Refactoring Azure-specific code for the Platform to make more efficient.
Release for 15-Jan-2019
Refactoring the filecloser functionality to address bugs.
Additional monitoring code with Prometheus added to file uploader.
Continued migration of existing SSO users to Okta SSO
Release for 08-Jan-2019
Concurrent Org Worker Limits:All orgs that do not have custom concurent worker limits will default to a maximum of 500 concurrent workers.
Refactoring of API servers for Okta tokens (impacts only customers moving to Okta SSO)
Refactoring of Nucleus for compatibility with MongoDB 3.4
Refactoring to fix bugs in dx_download
Release for 18-Dec-2018
Updates to the SCIM server for specific customers to integrate with the DNAnexus Platform Okta authentication server (no impact for all other customers)
Release for 11-Dec-2018
Deprecated command line interface (CLI) commands "dx sh" and "dx exit"
Internal refactoring of code, including adding internal monitoring and alerting functionality
Release for 04-Dec-2018
Added i18n/I10n support to allow the user interface to recognize the user's language selection
Release for 27-Nov-2018
Refactoring external API servers to support Ubuntu 16.04 and configure for autoscaling
Ability of the user to archive without requiring support intervention (AWS-East only)
Augmentation of the MongoDB server with AWS Aurora server (AWS only) for select customers
Support for HTTPS access for JupyterLab
Release for 13-Nov-2018
Updated the download proxy service to handle large volume of big files
Movement of SSO functionality from the internal Auth Server to Okta for an existing customer
Release for 06-Nov-2018
Custom expiration dates on tokens
User's profile now allows email preferences
Turned on the load balancer on the internal API server.
Release for 30-Oct-2018
Upgraded the nginx webserver to V15
Refactoring of the job manager to a high availability status
Allowing users to see the public symlink URL
Upgrade to REACT to V16 of the Javascript library
Release for 23-Oct-2018
Removed the social media links on the landing page of the Platform
Alerts to org admins when the audit trail is turned off (a configuration setting)
Release for 9-Oct-2018
Deployment of the Apollo functionality of the Translational Informatics Suite to appropriately licensed users
Refactoring code for data egress
Release for 25-Sep-2018
Refactoring of the beta-Apollo code (Translational Informatics Suite)
Refactoring of data egress functionality
Last updated