Skip to content

Instantly share code, notes, and snippets.

@jaybuff

jaybuff/gist:4f2b390c886d76ba6060

Created June 20, 2014 16:48
Show Gist options
  • Save jaybuff/4f2b390c886d76ba6060 to your computer and use it in GitHub Desktop.
Save jaybuff/4f2b390c886d76ba6060 to your computer and use it in GitHub Desktop.
Download ZIP
aurora-scheduler -help output
Raw
gistfile1.txt
$ ./aurora-scheduler.sh
+ AURORA_SCHEDULER_HOME=/usr/local/aurora-scheduler
+ JAVA_OPTS=(-server -Xmx1g -Xms1g -Djava.library.path=/usr/lib64)
+ AURORA_FLAGS=(-help)
+ export GLOG_v=0
+ GLOG_v=0
+ export LIBPROCESS_PORT=8083
+ LIBPROCESS_PORT=8083
+ export LIBPROCESS_IP=17.177.63.106
+ LIBPROCESS_IP=17.177.63.106
+ PATH=./:/usr/local/rbenv/bin:/opt/siri/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/Users/jaybuff/bin
+ JAVA_OPTS='-server -Xmx1g -Xms1g -Djava.library.path=/usr/lib64'
+ exec /usr/local/aurora-scheduler/bin/aurora-scheduler -help
Jun 20, 2014 4:46:10 PM com.twitter.common.args.apt.Configuration load
INFO: Loading @CmdLine config from: [jar:file:/usr/local/aurora-scheduler/lib/client-flagged-0.0.5.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/server-set-1.0.74.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/application-module-http-0.0.62.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/application-module-log-0.0.56.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/application-module-stats-0.0.44.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/application-0.0.73.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/args-0.2.9.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/logging-0.0.61.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.1, jar:file:/usr/local/aurora-scheduler/lib/quark-aurora-package-0.5.1-SNAPSHOT.jar!/com/twitter/common/args/apt/cmdline.arg.info.txt.2]
-------------------------------------------------------------------------
-h or -help to print this help message
Required flags:
-backup_dir [not null]
Directory to store backups under. Will be created if it does not exist.
(org.apache.aurora.scheduler.storage.backup.BackupModule.backup_dir)
-cluster_name [not null]
Name to identify the cluster being served.
(org.apache.aurora.scheduler.app.SchedulerMain.cluster_name)
-framework_authentication_file
Properties file which contains framework credentials to authenticate with Mesosmaster. Must contain the properties 'aurora_authentication_principal' and 'aurora_authentication_secret'.
(org.apache.aurora.scheduler.DriverFactory.DriverFactoryImpl.framework_authentication_file)
-mesos_master_address [not null]
Address for the mesos master, can be a socket address or zookeeper path.
(org.apache.aurora.scheduler.DriverFactory.DriverFactoryImpl.mesos_master_address)
-mesos_ssl_keyfile
JKS keyfile for operating the Mesos Thrift-over-SSL interface.
(org.apache.aurora.scheduler.app.SchedulerMain.mesos_ssl_keyfile)
-serverset_path [not null, must be non-empty]
ZooKeeper ServerSet path to register at.
(org.apache.aurora.scheduler.app.SchedulerMain.serverset_path)
-thermos_executor_path [not null]
Path to the thermos executor launch script.
(org.apache.aurora.scheduler.app.SchedulerMain.thermos_executor_path)
-zk_digest_credentials
user:password to use when authenticating with ZooKeeper.
(com.twitter.common.zookeeper.guice.client.flagged.FlaggedClientConfig.zk_digest_credentials)
-zk_endpoints [must have at least 1 item]
Endpoint specification for the ZooKeeper servers.
(com.twitter.common.zookeeper.guice.client.flagged.FlaggedClientConfig.zk_endpoints)
Optional flags:
-alsologtostderr=false
Log messages to stderr, in addition to log files. Ignored when --logtostderr
(com.twitter.common.logging.RootLogConfig.alsologtostderr)
-async_slot_stat_update_interval=(1, mins)
Interval on which to try to update open slot stats.
(org.apache.aurora.scheduler.stats.AsyncStatsModule.async_slot_stat_update_interval)
-async_task_stat_update_interval=(1, hrs)
Interval on which to try to update resource consumption stats.
(org.apache.aurora.scheduler.stats.AsyncStatsModule.async_task_stat_update_interval)
-async_worker_threads=1
The number of worker threads to process async task operations with.
(org.apache.aurora.scheduler.async.AsyncModule.async_worker_threads)
-auth_module=class org.apache.aurora.auth.UnsecureAuthModule
A Guice module to provide auth bindings. NOTE: The default is unsecure.
(org.apache.aurora.scheduler.app.SchedulerMain.auth_module)
-backup_interval=(1, hrs)
Minimum interval on which to write a storage backup.
(org.apache.aurora.scheduler.storage.backup.BackupModule.backup_interval)
-cron_scheduler_num_threads=100
Number of threads to use for the cron scheduler thread pool.
(org.apache.aurora.scheduler.cron.quartz.CronModule.cron_scheduler_num_threads)
-cron_start_initial_backoff=(1, secs)
Initial backoff delay while waiting for a previous cron run to be killed.
(org.apache.aurora.scheduler.cron.quartz.CronModule.cron_start_initial_backoff)
-cron_start_max_backoff=(1, mins)
Max backoff delay while waiting for a previous cron run to be killed.
(org.apache.aurora.scheduler.cron.quartz.CronModule.cron_start_max_backoff)
-cron_timezone=GMT
TimeZone to use for cron predictions.
(org.apache.aurora.scheduler.cron.quartz.CronModule.cron_timezone)
-deflate_snapshots=true
Whether snapshots should be deflate-compressed.
(org.apache.aurora.scheduler.storage.log.LogStorageModule.deflate_snapshots)
-dlog_max_entry_size=(512, KB)
Specifies the maximum entry size to append to the log. Larger entries will be split across entry Frames.
(org.apache.aurora.scheduler.storage.log.LogStorageModule.dlog_max_entry_size)
-dlog_shutdown_grace_period=(2, secs)
Specifies the maximum time to wait for scheduled checkpoint and snapshot actions to complete before forcibly shutting down.
(org.apache.aurora.scheduler.storage.log.LogStorageModule.dlog_shutdown_grace_period)
-dlog_snapshot_interval=(1, hrs)
Specifies the frequency at which snapshots of local storage are taken and written to the log.
(org.apache.aurora.scheduler.storage.log.LogStorageModule.dlog_snapshot_interval)
-enable_cors_for=*
List of domains for which CORS support should be enabled.
(org.apache.aurora.scheduler.http.ServletModule.enable_cors_for)
-enable_cors_support=false
Enable CORS support for thrift end points.
(org.apache.aurora.scheduler.http.ServletModule.enable_cors_support)
-enable_job_creation=true
Allow new jobs to be created, if false all job creation requests will be denied.
(org.apache.aurora.scheduler.thrift.aop.AopModule.enable_job_creation)
-enable_job_updates=true
Whether new job updates should be accepted.
(org.apache.aurora.scheduler.thrift.aop.AopModule.enable_job_updates)
-enable_preemptor=true
Enable the preemptor and preemption
(org.apache.aurora.scheduler.async.AsyncModule.enable_preemptor)
-executor_gc_interval=(1, hrs)
Max interval on which to run the GC executor on a host to clean up dead tasks.
(org.apache.aurora.scheduler.async.AsyncModule.executor_gc_interval)
-executor_user=root
User to start the executor. Defaults to "root". Set this to an unprivileged user if the mesos master was started with "--no-root_submissions". If set to anything other than "root", the executor will ignore the "role" setting for jobs since it can't use setuid() anymore. This means that all your jobs will run under the specified user and the user has to exist on the mesos slaves.
(org.apache.aurora.scheduler.DriverFactory.DriverFactoryImpl.executor_user)
-extra_modules=[]
A list of modules that provide additional functionality.
(org.apache.aurora.scheduler.app.SchedulerMain.extra_modules)
-flapping_task_threshold=(5, mins)
A task that repeatedly runs for less than this time is considered to be flapping.
(org.apache.aurora.scheduler.async.AsyncModule.flapping_task_threshold)
-framework_failover_timeout=(21, days)
Time after which a framework is considered deleted. SHOULD BE VERY HIGH.
(org.apache.aurora.scheduler.DriverFactory.DriverFactoryImpl.framework_failover_timeout)
-gc_executor_path
Path to the gc executor launch script.
(org.apache.aurora.scheduler.async.AsyncModule.gc_executor_path)
-guice_stage=DEVELOPMENT
Guice development stage to create injector with.
(com.twitter.common.application.AppLauncher.guice_stage)
-history_max_per_job_threshold=100
Maximum number of terminated tasks to retain in a job history.
(org.apache.aurora.scheduler.async.AsyncModule.history_max_per_job_threshold)
-history_min_retention_threshold=(1, hrs)
Minimum guaranteed time for task history retention before any pruning is attempted.
(org.apache.aurora.scheduler.async.AsyncModule.history_min_retention_threshold)
-history_prune_threshold=(2, days)
Time after which the scheduler will prune terminated task history.
(org.apache.aurora.scheduler.async.AsyncModule.history_prune_threshold)
-http_announce_port_names=[http] [must have at least 1 item]
Names to identify the HTTP port with when advertising the service.
(com.twitter.common.application.modules.HttpModule.http_announce_port_names)
-http_port=0 [must be >= 0 and <= 65535]
The port to start an HTTP server on. Default value will choose a random port.
(com.twitter.common.application.modules.HttpModule.http_port)
-http_primary_service=false
True if HTTP is the primary service.
(com.twitter.common.application.modules.HttpModule.http_primary_service)
-initial_flapping_task_delay=(30, secs)
Initial amount of time to wait before attempting to schedule a flapping task.
(org.apache.aurora.scheduler.async.AsyncModule.initial_flapping_task_delay)
-initial_schedule_delay=(1, ms)
Initial amount of time to wait before attempting to schedule a PENDING task.
(org.apache.aurora.scheduler.async.AsyncModule.initial_schedule_delay)
-log_dir [file must exist, file must be readable, file must be a directory]
The directory where application logs are written.
(com.twitter.common.application.modules.LogModule.log_dir)
-logtostderr=false
Log messages to stderr instead of logfiles.
(com.twitter.common.logging.RootLogConfig.logtostderr)
-max_flapping_task_delay=(5, mins)
Maximum delay between attempts to schedule a flapping task.
(org.apache.aurora.scheduler.async.AsyncModule.max_flapping_task_delay)
-max_leading_duration=(1, days)
After leading for this duration, the scheduler should commit suicide.
(org.apache.aurora.scheduler.SchedulerModule.max_leading_duration)
-max_registration_delay=(1, mins)
Max allowable delay to allow the driver to register before aborting
(org.apache.aurora.scheduler.SchedulerModule.max_registration_delay)
-max_reschedule_task_delay_on_startup=(30, secs)
Upper bound of random delay for pending task rescheduling on scheduler startup.
(org.apache.aurora.scheduler.async.AsyncModule.max_reschedule_task_delay_on_startup)
-max_saved_backups=48
Maximum number of backups to retain before deleting the oldest backups.
(org.apache.aurora.scheduler.storage.backup.BackupModule.max_saved_backups)
-max_schedule_attempts_per_sec=20.0
Maximum number of scheduling attempts to make per second.
(org.apache.aurora.scheduler.async.AsyncModule.max_schedule_attempts_per_sec)
-max_schedule_delay=(30, secs)
Maximum delay between attempts to schedule a PENDING tasks.
(org.apache.aurora.scheduler.async.AsyncModule.max_schedule_delay)
-max_tasks_per_job=4000 [must be > 0]
Maximum number of allowed tasks in a single job.
(org.apache.aurora.scheduler.state.SchedulerCoreImpl.max_tasks_per_job)
-min_offer_hold_time=(5, mins)
Minimum amount of time to hold a resource offer before declining.
(org.apache.aurora.scheduler.async.AsyncModule.min_offer_hold_time)
-min_offer_hold_time_jitter_window=(1, mins)
Upper bound of random jitter added to min_offer_hold_time.
(org.apache.aurora.scheduler.async.AsyncModule.min_offer_hold_time_jitter_window)
-native_log_election_retries=20
The maximum number of attempts to obtain a new log writer.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_election_retries)
-native_log_election_timeout=(15, secs)
The timeout for a single attempt to obtain a new log writer.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_election_timeout)
-native_log_file_path
Path to a file to store the native log data in. If the parent directory doesnot exist it will be created.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_file_path)
-native_log_quorum_size=1
The size of the quorum required for all log mutations.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_quorum_size)
-native_log_read_timeout=(5, secs)
The timeout for doing log reads.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_read_timeout)
-native_log_write_timeout=(3, secs)
The timeout for doing log appends and truncations.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_write_timeout)
-native_log_zk_group_path
A zookeeper node for use by the native log to track the master coordinator.
(org.apache.aurora.scheduler.log.mesos.MesosLogStreamModule.native_log_zk_group_path)
-offer_reservation_duration=(3, mins)
Time to reserve a slave's offers while trying to satisfy a task preempting another.
(org.apache.aurora.scheduler.async.AsyncModule.offer_reservation_duration)
-preemption_delay=(10, mins)
Time interval after which a pending task becomes eligible to preempt other tasks
(org.apache.aurora.scheduler.async.AsyncModule.preemption_delay)
-require_slave_checkpoint=false
DANGEROUS! Require Mesos slaves to have checkpointing enabled. When enabled a slave restart should not kill executors, but the scheduler will not be able to launch tasks on slaves without --checkpoint=true in their command lines. See DriverFactory.java for more information.
(org.apache.aurora.scheduler.DriverFactory.DriverFactoryImpl.require_slave_checkpoint)
-serverset_encode_json=true
If true, use JSON for encoding server set information. Defaults to true (use JSON).
(com.twitter.common.zookeeper.ServerSetImpl.serverset_encode_json)
-sla_stat_refresh_interval=(1, mins)
The SLA stat refresh interval.
(org.apache.aurora.scheduler.sla.SlaModule.sla_stat_refresh_interval)
-slow_query_log_threshold=(25, ms)
Log all queries that take at least this long to execute.
(org.apache.aurora.scheduler.storage.mem.MemTaskStore.slow_query_log_threshold)
-stat_retention_period=(1, hrs)
Time for a stat to be retained in memory before expiring.
(com.twitter.common.application.modules.StatsModule.stat_retention_period)
-stat_sampling_interval=(1, secs)
Statistic value sampling interval.
(com.twitter.common.application.modules.StatsModule.stat_sampling_interval)
-testing_isolated_scheduler=false
If true, run in a testing mode with the scheduler isolated from other components.
(org.apache.aurora.scheduler.app.SchedulerMain.testing_isolated_scheduler)
-testing_log_file_path
Path to a file to store local log file data in.
(org.apache.aurora.scheduler.log.testing.FileLogStreamModule.testing_log_file_path)
-thrift_port=0
Thrift server port.
(org.apache.aurora.scheduler.app.SchedulerMain.thrift_port)
-transient_task_state_timeout=(5, mins)
The amount of time after which to treat a task stuck in a transient state as LOST.
(org.apache.aurora.scheduler.async.AsyncModule.transient_task_state_timeout)
-use_glog=true
True to use the new glog-based configuration for the root logger.
(com.twitter.common.application.modules.LogModule.use_glog)
-use_glog_formatter=true
True to use the glog formatter exclusively.
(com.twitter.common.logging.RootLogConfig.use_glog_formatter)
-user_capabilities={ROOT=mesos}
Concrete name mappings for administration capabilities.
(org.apache.aurora.scheduler.thrift.auth.ThriftAuthModule.user_capabilities)
-viz_job_url_prefix=
URL prefix for job container stats.
(org.apache.aurora.scheduler.app.SchedulerMain.viz_job_url_prefix)
-vlog=INFO
The value is one of the constants in java.util.logging.Level. Shows all messages with level equal or higher than the value of this flag.
(com.twitter.common.logging.RootLogConfig.vlog)
-vmodule={}
Per-class verbose level. The argument has to contain a comma-separated list of <class_name>=<log_level>. <class_name> is the full-qualified name of a class, <log_level> is one of the constants in java.util.logging.Level. <log_level> overrides any value given by --vlog.
(com.twitter.common.logging.RootLogConfig.vmodule)
-zk_chroot_path
chroot path to use for the ZooKeeper connections
(com.twitter.common.zookeeper.guice.client.flagged.FlaggedClientConfig.zk_chroot_path)
-zk_in_proc=false
Launches an embedded zookeeper server for local testing causing -zk_endpoints to be ignored if specified.
(com.twitter.common.zookeeper.guice.client.flagged.FlaggedClientConfig.zk_in_proc)
-zk_session_timeout=(4, secs)
The ZooKeeper session timeout.
(com.twitter.common.zookeeper.guice.client.flagged.FlaggedClientConfig.zk_session_timeout)
-------------------------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment