Release Notes

Release for 25-Jan-2022

  • Update of security patches of identified vulnerabilities
  • Spend limit enforcements
  • Enhancements for job filters
  • Updates to the email filters
  • Apollo: fixes to address solution-exception messages, fixes of the update API calls, and removal of blank pages in the User Interface

No Release for 18-Jan-2022

Release for 11-Jan-2022

  • Service Provider Single Sign On (SSO)
  • User Interface fixes
  • CloudManager enhancements (internal)
  • Apollo: updates and fixes of reported issues

No Releases until 11-Jan-2022

Release for 14-Dec-2021

  • Fixes to Cloud Manager, visibility into the org license for the org-admins
  • Remove all Ubuntu 16.04 instances from production. Ubuntu 16.04 is available at the app level
  • UI fixes to the monitor pages; improve state transition with regard to Jupyter Notebooks
  • Apollo: refactoring known issues, such as nametags, etc.

Release for 07-Dec-2021

  • User Interface fixes to cancel transfers
  • Fixes for the initiation of nested workers and the API call for apprun worker limits
  • Monthly Security patches
  • Apollo: fixes for zero length files, security patches to packages and libraries

Release 30-Nov-2021

  • Button changes on the Web User Interface
  • Throttling renabled, refactoring of known issues

No Release for 23-Nov-2021

Release for 16-Nov-2021

  • Complete migration of the UI to React 17 with UI changes to the Data manager, removal of the Global Search button
  • Refactoring of known issues, such as fixes to watermarks, etc.

Release for 9-Nov-2021

  • Additional metrics for spinup and interval time for instances
  • User Interface infrastructure updates to React 17
  • Infrastructure consolidation for load balancing
  • Security patching
  • Apollo: refactoring of known issues

No Release for 2-Nov-2021

Release for 26-Oct-2021

  • Org Admin can view each org member's userID and email address
  • Refactoring minor bugs, including fixing timoues and fixes to allow additional flexibility for UKB dispensals
  • Apollo: Refactoring known issues

Release for 19-Oct-2021

  • UI fix to https workers
  • Refactoring of many reported UI issues
  • Refactoring of unarchive issues
  • Org Manager can access the org user's email addresses
  • Refactoring of the UKB rate card
  • Self-service billing for UKB RAP and PayGo customers only
  • Apollo: no release

No Release for 11-Oct-2021

Release for 05-Oct-2021

  • Monthly Security Patching
  • Deprecation of Global Search
  • Apollo: no release

Release for 28-Sep-2021

  • Refactoring of CloudManager
  • Additional heartbeat monitoring of the infrastructure
  • Refactoring of user interface issues
  • Apollo: Refactoring of known lissues and updating the version of tRNA to feed Apollo

Release for 21-Sep-2021

  • Changes to timeout on instance re-use
  • Updates to the billing daemons
  • Updates on data withdraw and refresh process
  • Moving infrastructure components to node.js v12
  • Apollo: Update of Spark to support v3.1.2 and fixes to database pointers
  • Apollo available in AWS-Frankfurt

Release for 14-Sep-2021

  • Additional logging for cluster jobs
  • Added additional time for reserve instances
  • Efficiency enhancements for listing projects
  • User Interface fixes to reported bugs
  • Chef upgrade on the infrastructure
  • Apollo: Deprecation of the legacy chort browser, efficiency enhancements of Spark and other fixes.

No Release for 07-Sep-2021

Release for 31-Aug-2021

  • Updates to Job Manager and Cloud Manager
  • Refactoring of issues on the User Interface
  • Apollo: refactoring of filter parameters, UI and Spark 3.x upgrades

Release for 24-Aug-2021

  • Audit logging updates
  • Refactoring of the User Interface issues
  • Sendgrid changes for event-based email notifications
  • Apollo: refactoring reported issues

Release for 17-Aug-2021

  • London region archiving
  • Refactoring of emall alerts
  • Code efficiencies pertaining to audit trail generation
  • Efficiencies added to the backend code to allow more efficient list of projects.
  • Apollo: refactoring known issues, efficiency enhancements and deprecation of the legacy Cohort browser

Release for 10-Aug-2021

  • Cloud Manager caching implemented in regions that use autoscaling
  • Refactoring of internal database to increase efficiency
  • Opening AWS region in London, will be visible on the user interface and rate cards in UK currency
  • Internal Splunk updated to v8.1.5
  • OpenJDK v11 updated on Ubuntu 18.04 AMIs
  • Apollo: No Release

Release for 03-Aug-2021

  • Switch to the Pannexin User Interface only
  • Data master fixes in the User Interface
  • Query optimizations
  • Internal migration of the org-specific audit logs to a more efficient process
  • Apollo: Refactoring of error messages, UI fixes to gene filter parsing an semiphore fixes for API calls

Release for 27-Jul-2021

  • Reset job fix
  • jQuery update
  • Master Daata UI fixes
  • lambda functions update
  • increase Cloud Manager Resilience
  • Apollo: Refactoring known inssues, including updates for code efficiencies and documentation

Release for 20-Jul-2021

  • Restart job fix
  • Internal update of jQuery to v3.6.0
  • Monthly vulnerability patching implemented in production
  • Apollo: Refactoring of known issues, including some minor refactor of UI for efficiencies

Release for 13-Jul-2021

  • Additions to ProjectDescribe API to include ranking field
  • Visualization tab of the User Interface will be migrated to the newer version (Pannexin)
  • Job Manager efficiences

No Release for 05-Jul-2021

Release for 29-Jun-2021

  • Archive API updates
  • Platform refactoring: Fixes to the User Interface and error handling when project files do not exist
  • UUbuntu 12.04 and 14.04 instances will be deprecated. Workers using Ubuntu from 16.04 to 20.04 will continue to be supported.
  • Apollo: Refactoring of R functionality and fixes to license checks

Release for 22-Jun-2021

  • Updates to the billing page
  • Fix to the GetDetails call, handling of incorrect API calls and code efficiencies
  • Updating API servers to Ubuntu 18.04, security patching of infrastructure
  • Fixes to getFileStatusURL, verify all filter values in an array, fixes in the data picker, fixes in the histogram functionality

Release for 15-Jun-2021

  • Upgrade of the dependencies of the Auth Server
  • Titan bugfixes
  • Org Page UI changes
  • Apollo: UI fixes

Release for 08-Jun-2021

  • Refactoring for handling regions, fixes on cost limits, fixed prioritization and long-term fix for watermarking
  • Egress Reporting
  • Apollo: refactoring issues
  • Apollo: TABBY release - moving sections to multiple tabs

No Release for 01-Jun-2021

Release for 25-May-2021

  • Fixes on Rush.js project dependencies
  • Correction of defects in the JobManager and JobEvents
  • DBCluster updates to the latest TypeScript
  • React.js library upgrade, which may have slightly changes to the visual appearance as well as possibly behavior changes
  • Corrections to UserDescribe functionality
  • Fixes FileStatus calls, changes for efficiency of filesystem calls, tuning cache sizes

Release for 18-May-2021

  • Minor AMI changes for logging
  • Revert of egress accounting change and some watermark functionality
  • Additional information from file describe on watermarked files
  • Functionality to allow org-admins to share projects across orgs
  • dxcompile support for bash variables
  • Ubuntu 14.04 depracated
  • Apollo: Fixing the total count number when multiple alleles are involved, performance enhancement on the underlying database access methods

Release for 11-May-2021

  • Job re-use with watermarking
  • Cloud Manager updates
  • Increase granularity in egress billing
  • Apollo: fixes of known issues, such as retry logic on read conditions and efficiency changes in the User Interface

Release for 04-May-2021

  • Updates to the DBcluster monitoring process
  • Re-deployment of dl-proxy modules to support ungraded infrastructure
  • Application context ID now included in the profiled projects, workers handle watermarked APIs, etc.
  • Implementing monthly vulnerability patching
  • Apollo: Fixes of known issues within Apollo, including data filter conditions and fixes to the Locus filter

Release for 27-Apr-2021

  • Refactoring of watermarking code to address issues
  • Refactoring of code performing bulk calls to reduce the volume of information returned
  • Updated the user experience (UI) with a new root component error page. Formerly, an error would show a blank screen when the worker crashed.
  • Implement Apollo on Azure West-US

Release for 20-Apr-2021

  • DBCluster services were updated to be more efficient.
  • Okta updates on dependencies
  • Fixes to the autoscaling of the Cloudmanager infrastructure
  • Fixes to the timestamps on expired/destroyed containers to integrate correctly in the metadata database
  • Expanded IP range on workers
  • PHI flag implemented on Azure
  • Implemented the 2FA authentication in the pannexin code (formerly only on the membrane UI code)
  • Apollo: Updates to the metadata connect functionality
  • Apollo: Fixes with the concurrency issues with API calls
  • Apollo: Efficiency updates to reduce the number of API calls

Release for 13-Apr-2021

  • Fix to allow UKB RAP users to download from multiple resources
  • Continued rollout of v6 to v12 upgrades to node.js in the APIproxy and CloudManager infrastructure
  • Updates to allow the cloud manager to handle tagged AMIs
  • Efficiency changes to the APIserver from the Monitor tab. UI fixes to the cohort browser where screen disappears and table crashes
  • All AMIs on AWS will be Ubuntu 18.04. AMI updates on Azure will come later. Older AMIs will continue to be supported
  • Apollo: Updates to the Vizserver to more efficiently use the API server and efficiencies implemented on the monitor badges.
  • Apollo: Resolved access issues to non-DNAnexus S3 buckets.
  • Apollo: Added DXDATA_CREATE_COHORT functionality to the product.

Release for 06-Apr-2021

  • Fix to userDescribe functionality
  • Fix to DBClusters
  • Okta SCIM update
  • Vulnerability patching
  • Refactoring of SSO token exchange
  • Apollo: Resolving issues accessing data in public S3 buckets, fixes for the data filters, and increased the efficiency of displaying tables in the User Interface

Release for 30-Mar-2021

  • Refactoring user describe functionality to provide greater visbility to the org-admin
  • Refactoring of minor User interface bugs
  • Apollo: Minor fixes to the filters

Release for 23-Mar-2021

  • Refactoring of the watermarking and UKB withdraws
  • Refactoring of User Interfaces, including multiple wildcard support
  • Apollo: refactoring of the Azure filesystem support and entity relationship filters

Release for 16-Mar-2021

  • Refactoring of functional issues related to: update job pricing, updating autoscaling of cloud manager, fixes to the event emitter components, updates to analysis describe to get increased mapping, increase org-admin ability to assign roles within their role, and efficiency fixes to the watermarking API calls.
  • Performance refactoring such as deletes on autothrottled instances, fixes of updates to update describe for field mapping to the User Interfaces as well as removing deprecated instances out of the code base.
  • User interface currency awareness
  • User interface capability to upload directly from S3 and Blob storage
  • Apollo: refactoring of issues arising from Azure filesystem
    Release for 09-Mar-2021
  • Supporting GPU and high memory instances on Azure
  • Apollo: Now available on Azure (US-West)
  • Refactoring of Titan to fix hanging and uassigned cluster jobs, etc.
  • Updates to the dependencies of the Okta-SCIM servers
  • Bugfixes to projectDescribe
  • Expanding the ability to CLI ability to lower a job's priority to the UI
  • Apollo: fixes to configuration tables on Azure; when a configuration table is incomplete, it is no longer flagges as an error.

Release for 02-Mar-2021

  • Failed job restart fixes
  • Implemented the autoscaling Cloud Manager in the AWS-London region for UKB RAWP
  • Increased the granularity of reporting of Worker egress and access to heartbeat frequency
  • Restricted ability to change addBilltoRegion
  • File closer efficiency for files >1TB
  • New worker types in Azure
  • UI refractoring of bugs
  • Fix issues with orchestration scripting for running cluster jobs, bare SQL supported

Release for 23-Feb-2021

  • Cloud Manager on Azure updated for cluster jobs
  • Fixes on UI components to limit length of org-names, etc.
  • Apollo: Cosmetic fixes to Scatterplot and rerfactoring filters in the query builder. Added "is-not" filter condition

Release for 16-Feb-2021

  • Minor changes to org-design descriptor
  • Additional logging info for terminated spot jobs on AWS
  • Fixes to org-describe API to identify project calls for UKB RAP
  • Node.js updated to v12 for archiving
  • Apollo: Fixes to close database command and readfile cache. Added efficiencies for field selection UI activity

No Release for 09-Feb-2021

Release for 02-Feb-2021

  • User Interface fixes
  • Monthly security vulnerability patches, including the sudo vulnerability in Ubuntu
  • Updates to node.js v12 for Execserver
  • Apollo: fixes to vizserver and UI of cohort browser

Release for 26-Jan-2021

  • Additional enhancements to gather information from job fails to be captured in the audit log.
  • Graphic redesign of the download proxy (allow folders and multiple files (up to 100) to be downloaded)
  • Moving primary Authentication Server to Ubuntu 18.04
  • Apollo: R-based Apollo Dataset SDK
  • Apollo: Completion of filters
  • Apollo: User interface efficiencies

No Release for 19-Jan-2021

Release for 12-Jan-2021

  • Backend fixes to DBCluster
  • UI fixes to project transfer flow
  • UI vulnerability fix for PRSSI

Release for 05-Jan-2021

  • Monthly updates to address infrastructure vulnerabilities
  • Added one more access priv to HTTPS-worker (fix)
  • Limiting Customer Cloud Account to specific API calls, etc.
  • Backend changes to cloning files from the archive
  • UI fixes to datamanager
  • Apollo: refresh of apps on Apollo to address bugs

No Release for 28-Dec-2020

No Release for 22-Dec-2020

Release for 15-Dec-2020

  • UI refactoring to address 3.0 re-route issue and a fix to allow the batch input selection
  • Change to address email notifications when there are failed jobs. When massive (e.g. >thousand of more) fail from a workflow, email was sent for every job failure. This behavior will change to a limited set of emails focusing on the parent jobs only.
  • Health checks on the internal Cloud Manager
  • Transition of internal servers to node.js v12
  • UI changes in for UK BioBank users
  • Apollo: adding existential filter

Release for 08-Dec-2020

  • Updating Sendgrid emails (job status emails are processed via sendgrid)
  • Updating SSL credentials for 2021
  • UI fixes to allow the user to switch between cohort browsers
  • UI fix for the processing of long and complicated workflows/pipelines
  • Fix of job manager to accomodate detached jobs from appropriately licensed customers
  • Add access to Jupyter Notebook Previewer via the UI
  • Apollo: refactoring of the rsid filter
  • Apollo: Allow for version switch to support Apache Spark V3.0.1

Release for 01-Dec-2020

  • Fix for CanSeePrices to check the currency type (USD or GBP)
  • Fix of issues in the download proxy
  • Fix of the withdraw service for UK BioBank
  • Efficiency and performance enhancements for job re-use functionality
  • Update logic for price currency (USD and GBP)
  • Jupyter Notebook file viewer
  • Apollo: Minor refactoring of the filters

No Release for 24-Nov-2020

Release for 16-Nov-2020

  • Employing a shared image gallery for workers in AWS and Azure.
  • Turn on autoscaling for the Cloud Manager in the AWS EU-West region only
  • Correction on measuring the runtime of cluster jobs
  • Refactoring of data dispensal issues
  • UI refactoring of Data Manager and Cohort browser to address issues
  • Rollout of the Ubuntu 18.04 operating system to the internal services of DNAnexus
  • Apollo: Refactoring reported issues with Apollo and documentation updates

Release for 10-Nov-2020

  • Refactor of worker job limits to allow user to continue launching jobs until their user limit is exhausted in orgs where they have not hit their limit.
  • Refactoring of association checker function
  • Exposed data egress monitoring performed by the worker (broken out from overall data egress)
  • Refactoring of issues of Cloud Manager on Azure spokes
  • Patching of infrastructure vulnerabilities
  • Updating the billing information to break out un-archiving charges from the archiving charges
  • Apollo: refactoring issues

Release for 03-Nov-2020

  • Add currency field to the job_analysis_describe command
  • Initial fixes for the File Viewer for the Safari viewer (MacOS native browser)
  • Refactoring of the Cloud Manager log reporting into the SIEM (more information) and log rotation on the Cloud Managers
  • Apollo: Refactoring reported issues with Apollo, including file status cache issues resolved, fixes to the helper method for exploding columns, etc.

Release for 27-Oct-2020

  • Job Manager and Cloud Manager autoscaling
  • Detached Job functionality added
  • Guard rail on number of objects to limit to less than 100,000 objects per command
  • User Interface fixes to the login redirect URL
  • Efficiencies for data dispensal application
  • Apollo: refactoring reported issues
  • Tools: Original Quality Functionality Equivalent app released - see:

Release for 20-Oct-2020

  • Refactoring of the Cloud Manager for efficiency and resolution of issues
  • Refactoring for more efficient communication between the Job Manager and the internal API Server
  • Make default the view of the archive data usage.
  • Enable logging of API functions that call other API calls (e.g. API_1 --> API_2 --> API_3)
  • User Interface Refactoring cleanup
  • Apollo: Refactoring of reported issues, such as fixes when multiple spark clusters are using the same file, etc.

Release for 13-Oct-2020

  • Refactoring of user describe functionality, lambda updates for performance, fixes to RegionIPRegions to map from the spokes to the user's IP space and improved efficiency of the archive state check functionality
  • User interface performance fixes - specifically in the data manager
  • Security vulnerabilities for infrastructure were patched
  • node.js upgrades in the infrastructure
  • Apollo: fixes to the scatter plot and dates of the histogram functionality. Fixes to parsing large files (> 2G).

Release for 06-Oct-2020

  • Additional tuning of the Cloud manager for autoscaling
  • Minor refactoring of "find" API call to return all possible items
  • Data manager in the user interface will continue to show the size of the objects, but the size will no longer show the size of all related objects
  • Ubuntu 20.04 is available for workers in all clouds (AWS and Azure) in all regions.
  • Internal instances of nginx are upgraded to version 1.18
  • Apollo: Additional refactoring to address issues with the cohort browser, version changes in dxdata, and entity support for boxplot

No Release for 29-Sep-2020

  • The planned release was canceled.

Release for 22-Sep-2020

  • Additional tuning of the Cloud manager for autoscaling
  • Internal refactoring to expand the user describe functionality for spot instances, kill-switch when jobs hit their pricing limitations, and additional reporting from the API servers
  • Internal nginx servers upgraded to 1.18
  • Apollo: additional refactoring to the cohort browser

Release for 15-Sep-2020

  • Update of cloud Manager for autoscaling
  • User Interface refactoring of known issues
  • Apollo: Refactoring of locus controls, genomic range controls and decimals in the histogram

No Release for 08-Sep-2020

Release for 01-Sep-2020

  • Refactor cloudmanager for VPC changes
  • Refactoring of the operation of cluster computing in workflows
  • Apollo: fixes to handling netstat error. Refactorig of the cluster packages and use of the appropriate signatures in Apollo components.
  • Apollo: go live of Apollo in the London cloud for select customers.

Release for 25-Aug-2020

  • Refactoring links between the Job Manager and API server
  • Added DNA_API_PROVDER_DESCRIBE functionality to the Platform
  • Addition of AWS-London cloud to DNAnexus environment for specific customers
  • Vulnerability patching of the DNAnexus cloud infrastructure
  • Apollo: Refactoring of V3 of data/time and max/min range of the histogram. Added boxplot explod functionality for hierarchical and multicolumn selections

Release for 18-Aug-2020

  • Refactoring of the autoscaling within the Platform
  • User Interface refactoring (restoration of breakcrumbs in the data manager and highlighting)
  • Apollo: upgrade of the VisZerver to the V3 distribution

Release for 11-Aug-2020

  • Cloud Manager refactoring
  • Updates to Grub2 and other security fixes
  • Upgrades to Docker containers/pilot
  • Apollo: backend changes to Histogram, ScatterPlot and descriptor functionality

Release for 04-Aug-2020

  • Updates to internal servers - API Servers to Ubuntu 20.04
  • Refactoring of database cluster in the infrastructure
  • Refactoring of the project describe functionality to address issues
  • Okta-SCIM updates (SSO for customers)
  • Apollo: internal code to perform additional data payload verification tests, cohort code refactoring and updating dx-data in Docker.

Release for 28-Jul-2020

  • User Interface Refactoring, including adding users to org by email, fixes to password complexity, UI footer style checks and a fix for a race condition occasionally seen when selecting folders.
  • Cloud Manager refactoring
  • Proxy Lock refactoring for the China region only.
  • OktaSCIM changes

Release for 21-Jul-2020

  • Updates to the external SSO - Okta SCIM
  • Fix for the SQS SendMessage batch message length to allow for larger messages
  • User Association Page
  • Apollo testing framework update

Release for 14-Jul-2020

  • Refactoring known user interface issues, fixes to data manager
  • Routine updates of NVIDIA drivers for the AMI instances that use GPUs (includes security update)
  • Fixed occasional bugs in upload proxy; fixes to detached job issues
  • Apollo: Refactoring of code to support V3

Release for 07-Jul-2020

  • Enhancements for internal robustness of the https-worker client
  • User interface refactoring, including changing the load spinner to reflect current brand colors
  • Apollo: align ownership of internal files for smoother processing, updating panda and internal query routes. Updates on v3 of the updater and data loader.

Release for 30-Jun-2020

  • Fix for jobeventsconsumer code for old objects
  • Completed fix for JobManager API calls
  • Update to https-workder to allow custom names
  • Apollo: dxdata refactoring and added compatibility check when uploading data

Release for 23-Jun-2020

  • Refactoring of the internal platform message queue to decrease the number of calls from the redis server.
  • Increase platform robustness by refactoring the jobEventQueue and Standard Queue
  • User Interface refacotring in the data manager
  • Apollo: Refactoring cluster log collection and arguments of the vizserver API. Fixes in the backend components to support the allele frequency functionality.

Release for 16-Jun-2020

  • UI refactoring ("pannexin"), including deprecation of unused code, fix for missing file size in file preview for image/pdf, refactoring of the data manager and fix of the range filterin in GWAS Manhattan dataset.
  • Added government required links regarding contacts and abuse to the China cloud of DNAnexus.
  • Refactoring of log rotation within the Platform
  • Apollo: Changes of the vizserver to support the new software versi0ons in the backend, API refactoring and collection of logs in the Spark cluster.

Release for 9-Jun-2020

  • Minor bugfixes in the Platform, such as resolving symlinks, etc.
  • User Interface switch between the legacy UI "Membrane" and newer UI "Pannexin"
  • Disable public user from executing a user-describe functionality (security enhancement)
  • FedRAMP email channel through Salesforce is activated
  • Common password rejection
  • Apollo: refactoring of API design, update error messages, date & time fixes, and upgrade to the HAR files

No Release for 02-Jun-2020

No Release for 26-May-2020

Release for 19-May-2020

  • Refactoring Cohort Comparison Browser
  • Move the legacy authentication server to Python 3
  • Security fix for stylesheets

No Release for 12-May-2020

Release Notes for 05-May-2020

  • Updates to the Okta SCIM SSO server
  • Refactoring of the nginx web server on the worker AMIs to resolve existing issues
  • Apollo: refactoring geno cohort filter

Release Notes for 28-Apr-2020

  • Cookie notice will appear in compliance with EU requirements
  • Minor fixes to node.js installers and packaging (internal)
  • Refactoring of existing Cloudmanager to increase the monitoring scope
  • Apollo: Added DNA_GUI_SURVIVAL_PLOT functionality in the cohort browser. Added support on Azure for the Thrift server integration from VizServer

Release Notes for 21-Apr-2020

  • Refactoring of Cohort browser and Companion browser, including max/min labels on charts, color changes in some icons
  • Infrastructure refactoring to node.js installers and packaging.

Release Notes for 14-Apr-2020

  • Internal refactoring of the Azure Cloud Manager to handle docker containers
  • UI refactoring for project list, set bill-to components, and cohort browser/comparison
  • Apollo: added DNA_GUI_COHORTCOMPARE_LOAD functionality

Release Notes for 07-Apr-2020

  • Upgrade internal platform to Mongo 3.6 (in compatibility mode)
  • UI changes to Manhattan plot zooming and refactoring of Cohort Browser/comparisons
  • Apollo: Added TIP_APPS_PLATO_GWAS functionality

Release Notes for 31-Mar-2020

  • New Lambda function for internal autoscaling
  • Storage accounting updater daemon added (internal only)
  • Upgrade the internal version of Python from 2.7 to 3.x

Release Notes for 24-Mar-2020

  • Refactoring Pannexin User Interface (e.g. fixing zeros that showed up in preview, but held values)
  • Update Okta-SCIM infrastructure
  • Refactoring cohort browser

Release Notes for 17-Mar-2020

  • Upgrades and refactoring of the Cloudmanager on the Platform
  • Refactoring to existing cohort browser (e.g. list, nodeSearch and cohort comparison paging)
  • Apollo: minor refactoring to address issues in the backend.

Release Notes for 10-Mar-2020

  • Refactoring to existing cohort browser
  • Security patches to the user interface
  • Apollo: Added the following functionality: DNA_GUI_REMOVE_ALL_TILES

Release Notes for 03-Mar-2020

  • Self-service archiving on Azure
  • Python 3 rollout in Platform infrastructure
  • Apollo: refactoring of existing code

Release for 25-Feb-2020

  • Platform - refactoring of known issues
  • Apollo: additional data loader functionality

No Release for 18-Feb-2020

Release for 11-Feb-2020

  • Minor refactoring on the Platform and infrastructure for Azure and AWS clouds
  • Apollo: minor refactoring of outstanding bugs in Vizserver

No Release for 4-Feb-2020

Release for 28-Jan-2020

  • Upgrade internally to Ubuntu 16.04 (from Ubuntu 14.04)
  • Refactoring of Apollo - minor bugfixes

No Release for 21-Jan-2020

Release for 14-Jan-2020

  • Job Manager changes to allow Job Manager to talk to internal API servers via tokens
  • Cluster job failure resolution - if there are multiple failures, will quit
  • Refactoring of cohort browser at the UI level
  • Apollo: Update to Python 3.7 in the backend

Release for 07-Jan-2020

  • Refactoring s3deleter code
  • Refactoring internal billing code
  • Cloud Manager changes to support GPU instance types
  • Pricing code changes for multi-region AWS archiving
  • Apollo: Refactoring histogram functionality
  • Apollo: Implementation across Azure (not just AWS)

No Release for 24-Dec-2019

Release for 17-Dec-2019

  • Refactoring of archive modal iconf, data catalog page presentation fixes, UI efficiency improvements, add support for number format for 'e(+/-)', fix for the medusa update, data limits message clarified, documented tile requirements, fix cohort browser UI to allow dashboardConfig without any geno data components, fix filter pills overflow, remove usage of limits for charts from fieldsJSON and parallelize jenkins tasks.
  • Selective release of new functionality to support relational databases
  • Apollo: Minor refactoring of sorting file parts before joining, link datasort from selected cohorts, set reverse DNS lookup to false, store genoBins in cohort details and update specific multi-part upload configs on Azure

Release for 10-Dec-2019

  • Replace old DNAnexus logo on error pages
  • Remove old archival code
  • Apollo: refactoring binBy histogram code, license check code, and tipsync feature

Release for 03-Dec-2019

  • Additional instances types added for DB Cluster
  • File archiving in China
  • UI changes
  • File archiving refactoring
  • Apollo: filter options
  • Apollo: Looker sunset

No Release for 26-Nov-2019

No Release for 19-Nov-2019

No Release for 12-Nov-2019

Release for 05-Nov-2019

  • Refactoring User Interface to include SSL headers
  • Pages listing org-admins moved to the Pannexin user interface
  • Enable GPU instances in China cloud
  • Refactoring of the DB Cluster code
  • Refactoring of the file archiving code
  • Apollo: Minor refactoring of code and documentation

Release for 29-Oct-2019

  • Extended refactoring of file archiving in areas such as timeouts, increased efficiencies, etc.
  • Add license checks to ensure files can be downloaded
  • Refactoring of the cohort browser user interface.
  • Horizontally scaling CloudManager to handle more concurrent workers by sharding within each instance type.
  • Release of autoscaling of the authorization server to allow for high availability as the usage increases
  • Apollo: Refactoring of select queries, trimming of caches, etc.

Release for 22-Oct-2019

  • Refactoring of billing code with respect to file archiving (internal functionality)
  • Additional code to ensure the filenames of files to be archived have not already been archived
  • Apollo: refactoring of Basic 2 variable charts

No Release for 15-Oct-2019

Release for 08-Oct-2019

  • Refactoring self-service archiving, including the user interface and checks to make sure the files to be archived have not been deleted since the archiving process started
  • Refactoring the CloudManager on AWS to handle more concurrent workers (via load balancers)
  • User Interface refactoring in pannexin for the cohort browser and customer-specific browsers
  • Apollo: minor refactoring for database support on Azure.

Release for 01-Oct-2019

  • Refactoring of the backend systems supporting Titan, including bugfixes for improvements, customer-specific user interface encements
  • Apollo: Additional code buildout for local processing on Azure clouds, removal of code to acess Looker (depracated visualization module).

Release for 24-Sep-2019

  • Refactoring of the user interface for improvements, customers-specific user interfaces.
  • Apollo: code buildout for local processing on Azure clouds, improvements in the cohort browser

Release for 17-Sep-2019

  • User Interface changes, including the overall look and feel, ain project folders and data selector.
  • Refactoring in Titan, including refactoring Mongo queries, additional internal error messages, etc.
  • Refactoring in Apollo around documentation and Mongo queries

Release for 10-Sep-2019

  • Add authentication token and labels at the end of the human readable audit trail
  • Change and add new instance clases (c.3.xlarge becomes c5.xlarge; new instance c5.9xlarge)
  • Horizontal scaling of CloudManager to handle more concurrent workers (AWS only)
  • Apollo: Minor refactoring of code supporting the viz server, API servers for list of folders and dxdownload support

No Release for 03-Sep-2019

Release for 27-Aug-2019

  • Minor changes to the Platform U(ser) I(nterface) to support the use of the visualization server in Apollo
  • Backend ability to push object to the archive (AWS only)
  • Apollo: Minor changes to the vizserver (visualization server)

Release for 20-Aug-2019

  • Refactoring dbcluster - fix where dbcluster gets stuck in "creating fix" step
  • HITRUST certification received
  • Feature switches - internally focused on billing
  • Audit Log filenames - only for customers with "human readable" audit logs, files will have a prefix of YYMMDD to allow natural collation
  • Apollo - revisions to cohort browser to enable multi-cohort charts
  • Apollo - integrate additional variant annotation sources

Release for 13-Aug-2019

  • Refactoring dbcluster code
  • Refactoring of job manager user interface - should be faster
  • Cleanup of the backend (not accessible to users) for Chart Builder, including support for importing CSV files
  • Apollo: Cleanup and removal of mapping of Spark (full transfer to Spark 2.2)

No Release for 6-Aug-2019

No Release for 30-Jul-2019

No Release for 23-Jul-2019

Release for 09-Jul-2019

  • User Interface - removing featured projects when there are no projects
  • Refactoring internal docker code
  • Refactoring internal dbcluster code
  • Apollo: batching filesystem deletes

No Release for 2-Jul-2019

Release for 25-Jun-2019

  • Refactoring of memory lead issues related to file closers
  • Refactoring of user interface for samples management
  • Moving wiki links hardcoded into the UI to the site
  • Apollo: SQS queuing for vizsync service
  • Apollo: users can add multi-variate charts to the cohort browser

Release for 18-Jun-2019

  • Apollo: Extending API Service module to obtain the SQL query from the Visualization Server
  • Apollo: Refactoring of occasional 404 error from the Thrift Server
  • Add DBCusterStart (relational database functionality) in CloudWatch
  • Refactoring to correct asserion error when using findDataObjects when using SortBy filed.
  • Expanded damemon to abandoned deleted files from a maximum of 1024 files to unlimited, after initial warning
  • Refactoring race conditions in jobs finding files in workstation.
  • Refactoring code for the community selector when the user has no communities
  • Migrating Jenkins nucleus jobs from Ubuntu 14.04 to 16.04
  • Downloading is stopped if the customer's account is out of money

Release for 11-Jun-2019

  • Apollo Refactoring: Disable functions that are no longer used (e.g. reload function and getFunctions)
  • Apollo Refactoring: Fix dataset sync for visualization between the API server and visualization serve
  • Apollo Refactoring: Log the start/end time between API calls
  • Apollo Refactoring: Fix the project feature access check
  • Move lambda functions from node 6.10 (end of life) to 10.x
  • Remove project file closer locking as this is no longer necessary
  • Move lambda functions from node 6.10 (end of life) to 10.x
  • Add archival billing events to stream to the billing apps
  • Modify community login and registration pages to current branding as well as hidRegistration option
  • Fix the page loading of Internet Explorer 11 (11.1087.16299.0) as well as an older version of IE (11.0.9600.1784.eIS)

Release for 03-Jun-2019

  • Apollo - Code to support sharding of relational databases. Default will be "off"
  • Apollo - SQL fixes to Looker
  • Apollo - Removing default of using vizservr as the default visualization service. User will need to specify visualization server
  • Refactoring header authorization in the user interface
  • Refactoring the code supporting community links on the Platform user interface
  • Update dx-toolkit to 0.281.0
  • Fix the internal tagging of the docker images on the Platform

No Release for 28-May-2019

Release for 20-May-2019

  • Minor revisions to the navigation bar in the header
  • Internal replacement of the MongoDB sotrage system from MMAP technology to WiredTiger technology
  • Refactoring of unarchive functionality
  • Slight styles changes to the navigation bar (no changes to the functionaly). User interface will move to v4 of WebPack.
  • Apollo - bring your own database (BYOD) to now include JDBC drivers for Postgres, msSQL, MariaDB, MySQL, Amazon Redshift and Oracle
  • Apollo - security update for Looker

Release for 14-May-2019

  • Slight changes to the Platform toolbar
  • Okta SSO account migration
  • Refactoring costing model for the arcidAT command
  • Refactoring of archive
  • Create docker service skeleton
  • Apollo move throttle to the server

Release for 07-May-2019

  • Refactoring of workiner execution for slow jobs
  • Refactoring of nucleus issues (fix of eventconsumer logging defect)
  • Cohort Browser is move to the standard Platform interface
  • Apollo refactoring to return runtime file-ID from dashboards for saving cohorts
  • Apollo Looker security update from v5.16.13 to v6.8.27 (latest)
  • Refactoring LXC address documented change from LXC 2.0.8 to LXC 2.0.11
  • Added larger instance type c5d.9xlarge
  • Fixed NVIDIA driver load for p3.2xlarge instances

Release for 30-Apr-2019

  • Clean up execserver code to address log truncation
  • Enable /dev /tmpfs setup and clean up LXC
  • Add archivedAt timestamp during the CloudArchival process
  • Apollo - pooling http client connectiopns for APIserver calls
  • Apollo - refactor connection pool configurations for APIserver client on thrift and metastore
  • Pannexin Tool Library Changes: improvements to the Tools Library, new user experience for the Tool Library whereby the information in /apps will be contained /panx/tools. /apps will go away; Tools Library now includes Global Workflows; Apps and Global Workflows launched through Tools Library will load in the new Tool Runner by default.
  • Enable trusted org-admins to lock/unlock, reset MFA for their org users.

Release for 23-Apr-2019

  • Web user interface can now run global workflows
  • Additional fixes to DBCluster
  • Provide a public IP address per worker on the Azure environment
  • Port of Jobmanager to a docker build base, which is based on Alpine
  • Upgrade Docker to 18.09.5. Simplify docker install
  • Separate the license from Jupyter Lab from Apollo so they can be licensed separately
  • Refactoring of code for the cloud archival containers

Release for 16-Apr-2019

  • Integrate JupyterLab into the menu functionality of the web interface for the Platform
  • Increase Node.js memory limit for the job log archiver service.
  • Implement a container function to manage the archive process.
  • Refactoring of Apollo code to address issues

Release for 09-Apr-2019

  • Refactoring of findProject API call
  • Support loading and interactive querying of full whole exome samples in Apollo
  • Unique ID of the Thrift Server used written to the audit log (Apollo)
  • Support for single node spark clustger (instead of requiring a minumum of 2 nodes; Apollo)
  • Updating the DNAnexus logos to new branding, primarily on CSS sheets of web pages
  • Detect and report worker filesystem errors in the worker log file
  • Refactoring of code to make sure archiving does not include symlinks
  • fix for datbase sort memory limit with findProject memory limitation

Release for 02-Apr-2019

  • File leve archive for API and CLI support to archive and unarchive files, folders and projects
  • Fix to completely delete the files in scope on Auzre
  • Fixes for the internal dbCluster database files
  • Pooling fo services on Apollo so that small jobs doe not get caught behind large jobs.
  • Tuning of Prometheus sensing software

Release for 26-Mar-2019

  • Apollo refactoring of reconnection, fix for ORC file formats and fix to make sure the error messages are correct.
  • Platform to restrict the running ot HTTPS apps
  • Platform to upgrade NVIDIA driver on relevant workers
  • Drone moved to the same VPC as Artifactory (no functionality change)
  • Implement new billing eents database
  • fixes to bill for file archiving

No Release for 18-Mar-2019

No Release for 12-Mar-2019

Release for 05-Mar-2019

  • Refactoring of the MongoDB timeout parameters
  • Removing obsolete job group logging code from Apollo
  • Refactoring of filter in the getUSER api call

Release for 26-Feb-2019

  • Refactoring the m3.medium ephemeral disk space issue
  • fixing learna for archiving common packages
  • Updating the unarchived API logic
  • adding autoscape hosts to perform platform_pilot_status

No Release for 19-Feb-2019

No Release for 12-Feb-2019

Release for 05-Feb-2019

  • Adding internal metrics and alerts to the internal audit trails from the Platform.