Skip to content

Singularity 0.14.0
Compare
Choose a tag to compare
@ssalinas ssalinas released this 13 Mar 17:01
Singularity-0.14.0
46b66a0

NOTE!! - This release has a known bug with the Singularity UI. Please use 0.14.1 instead

Changes in 0.14.0

Check out the 0.14.0 milestone to see new features / bugfixes in detail.

Important

The next release of Singularity (0.15.0) will include an upgrade to java 8.

Configuration Changes

#1391 includes a rework of some of the S3 settings in Singularity. If you use the SingularityExecutor or SingularityExecutorCleanup modules and use the S3 upload features, you will need an update to your configuration. The fields for specifying which files to upload have been moved out of the SingularityExecutor. An example below shows all fields that would move.

Old Configuration which gets removed from SingularityExecutor and SingularityExecutorCleanup yaml files)

executor:
  s3UploaderBucket: my-logs-bucket
  s3UploaderKeyPattern: "%requestId/%Y/%m/%taskId_%index-%s-%filename"
  s3UploaderAdditionalFiles:
    - access.log
  s3StorageClass: "STANDARD_IA"
  applyS3StorageClassAfterBytes: 75000

New Configuration (if not already present for use with S3 log searching)

ADD TO SingularityExecutorCleanup YAML

# in SingularityExecutorCleanup yaml configuration
executorCleanup:
  defaultS3Bucket: my-logs-bucket
  s3KeyFormat: "%requestId/%Y/%m/%taskId_%index-%s-%filename"
  s3StorageClass: "STANDARD_IA"
  applyS3StorageClassAfterBytes: 75000
  s3UploaderAdditionalFiles:
   - filename: access.log
     # The default directory in the executor was set to 'logs', now it must be manually specified
     # If not specified, the directory to search for log files will be the task app directory in the sandbox
     directory: logs

ADD TO SingularityService YAML

s3:
  s3Bucket: my-logs-bucket
  s3KeyFormat: "%requestId/%Y/%m/%taskId_%index-%s-%filename"
  s3StorageClass: "STANDARD_IA"
  applyS3StorageClassAfterBytes: 75000
  s3UploaderAdditionalFiles:
   - filename: access.log
     # The default directory in the executor was set to 'logs', now it must be manually specified
     # If not specified, the directory to search for log files will be the task app directory in the sandbox
     directory: logs

NOTE - To upgrade smoothly, it is strongly recommended to deploy SingularityService and the SingularityExecutorCleanup before deploying the SingularityExecutor

New Features

  • 1306 - Smarter Healthchecks

Singularity healthchecks are now split into two phases. Previous settings will continue to function but are deprecated. Health check options are now specified in the healthcheck object on the SingularityDeploy See The new documentation for more on updates to healthchecks.

Improvements

  • 1435 - Updated mysql index on startedAt
  • 1449 - Improve status logging
  • 1434 - Match mesos artifact defaults
  • 1424 - Rename metric for immediate uploaders
  • 1427 - Ability to specify params on request history in client
  • 1429 - Standardize on toString/hash/equals formats
  • 1402 - Introduce offer cache to allow better resource allocation
  • 1399 - Add ability to upload files immediately to S3
  • 1417 - Ability to specify cache on mesos artifact
  • 1377 - Report currentActiveInstances on SingularityDeployProgress
  • 1410 - Use an ldap cache
  • 1414 - Add style to change display of overflow text in run now dialog
  • 1415 - Replace existing global search with search from requests page
  • 1411 - Logging clean up for mesos protos
  • 1334 - Sanitize file data before parsing with Jackson
  • 1386 - Add a DELETEING state for reqeusts being deleted
  • 1388 - send graphite datapoints with optional tags
  • 1391 - S3 Search Improvements
  • 1401 - Ability to override docker workdir
  • 1398 - Clarifications on S3ArtifactSignature
  • 1376 - Update request for 'deploy to unpause' before saving pending deploy
  • 1397 - Shade com.google.thirdparty
  • 1375 - Allow setting S3 storage class at upload time
  • 1373 - customizable --use-compress-program for tar
  • 1392 - Optionally skip addition of extra s3 metadata
  • 1382 - Add maxTasksPerOffer at request level
  • 1367 - Additional settings for history purger
  • 1360 - Bounce updates for placement and scaling
  • 1369 - Additional threshold for deleting task history row data in sql

Bug Fixes

  • 1437 - Defer loading log files till after page load
  • 1445 - use implicit acks when not offloading status updates to another thread
  • 1433 - Properly roll back from an overdue incremental deploy
  • 1426 - Prevent building duplicate immediate uploaders
  • 1412 - fix duplicate exit checker, add longer initial task wait
  • 1423 - Update docker parameters on deploy form
  • 1409 - Properly allow destroy task from ui
  • 1407 - Forbid more characters from request/deploy IDs
  • 1418 - Fixes for Immediate Uploaders
  • 1403 - Import formModal on racks page
  • 1371 - S3Downlaoder - Block on download only
  • 1387 - No retry for scheduled tasks run on-demand through UI
  • 1380 - Remove compressed log viewing endpoint
  • 1381 - remove all compressed log viewing code
  • 1372 - Update wrapper script for shell commands to read correct pid
  • 1368 - Read group from task data if present

Documentation

  • 1365 - Fix PATH in API annotations

Thanks

Assets 2
Loading