Skip to content

Singularity 1.1.0
Compare
Choose a tag to compare
@ssalinas ssalinas released this 20 Nov 19:53
Singularity-1.1.0
23e9166

Changes in 1.1.0

Check out the 1.1.0 milestone to see new features / bugfixes in detail.

Singularity 1.1.0 is mainly focused on scheduler performance. Internally we have also begun testing this version on java 11. Some java 11 notes:

  • While the default GC algorithm for java 11 has been updated to G1, we have seen better scheduler throughput and overall performance for SingularityService using parallelgc. We have not yet extensively tested zgc for Singularity
  • The SingularityExecutor must be upgraded to 1.1.0 to work with java 11. Earlier versions of all other components should still function on java11, but may not be as performant without the upadtes in this release
  • If using mysql with Singularity, the ssl-related updates in the updated version of mysql-connector-java will provide much better performance and remove an error that would previously get logged whenever a new connection was created

New Features

  • 2035 - New client method to get active tasks' ids
  • 2036 - Add endpoint to fetch all active task states
  • 2009 - Add ability to override environment in run now modal
  • 1971 - Filtered S3 task sandbox file search (API Only)

Improvements

  • 2039 - Make task history persister not use the request level lock
  • Scheduler Performance Improvements
    • 2034 - More performance updates
    • 2032 - Reconnect, offer, and startup performance improvements
    • 2023 - Cache deploy stats per offer check run
    • 2024 - Log lock hold times at debug level if too long
    • 2007 - More efficient use of state data
  • Java 11 Support Updates
    • 2025 - Upgrade mysql-connector-java
    • 2026 - Add jarkata runtime dep for executor module
    • 2020 - Update ProcessUtils to work with java11
  • 2018 - Add hour to s3 key format options
  • 2014 - Don't immediately clean all history items, let the history purger do it
  • 2008 - Make the request id global search include all but deleted requests
  • 2011 - Retry more TASK_LOST cases on deploy
  • 2012 - Show the runId in task tables on request detail page
  • 2000 - Module + ObjectMapper cleanup

Bug Fixes

  • 2038 - Catch more SQL exceptions in persister queries
  • 2037 - offer executor needs at least 2 threads
  • 2033 - Don't allow LB sync to remove last remaining upstreams
  • 2029 - Race condition fixes
  • 2022 - Just log the task ID in new task checker so we can see the throwable
  • 2019 - Remount RequestDetailPage when jumping between requests
  • 2021 - return early for missing deploy
  • 2016 - Ensure delayed oneoff tasks get rescheduled on new deploy
  • 2013 - Validate number of ports in run now resource overrides
  • 2010 - Clear resource usage after a new deploy
  • 2006 - Fix for overdue missing deploy
  • 2003 - Task history ui updates for sort
  • 2041 - Findbugs fixes

Documentation

  • 2015 - Updated cooldown docs

Thanks

Assets 2
Loading