S@E$      !"# Safe-Inferred$%$%$% Safe-Inferred&'(&'&'( None)*+,)+)*+,  Safe-Inferred-./01-./01-./01 NoneSets up hslogger.23456723456234567None@Sets up hslogger with a part logfile, part stdout configuration. None89:;<=89:;89:;<= Safe-Inferred None+0>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[>?@ABCDEFGHIJKLMNOPQRSTU >DC?@ABEHFIGJ SQOMKTURPNRLVWXYZ[None\]^_\]\]^_None `abcdefghi`abc`abcdefgh Safe-Inferredjklmnopqrstuvwxyz{jklmnopqrstuvwxyzjlkm nopqrstuvwxyz{None|}~|}|}~None Safe-InferredThis is a small common ground for some assumptions: input is a list of sth., deserialization is the responsibility of the task itself.None+0$NoneNoneNoneNoneNoneZMakes an external system call, parameters must match those read in RemoteExecutionSupport.xSome methods parse the contents of stdout, thus these will fail in the case of logging to it (only ERROR at the moment). `abc NoneNoneNoneNone1Apply the task on the data, producing either a location, where the results are stored, or the results directly. Which of those depends on the distribution type, when external programs are spawned the former can be more efficient, but if there is no such intermediate step, a direct result is better. |  NonehRepresents the results of a single remote execution, including multiple results from parallel execution.0Start a slave listening on given hostname, port. Run a calculation on all accessible slaves. This is a low-level method, look at the RunComputaiton module for a nicer interface.hTries to find work for every worker node, looking at all tasks, forgetting the node if no task is found.DNote (obsolete, but may be reactivated): tries to be open to other result types but assumes a list of results, as these can be concatenated over multiple tasks. Requires result entries to be serializable, not the complete result - confusing this can cause devastatingly misleading compiler complaints about Serializable. | List all accessible slaves. eList all accessible slaves that have at least a single block of the specified path stored physically. :Convenience method to stop all accessible slaves remotely.+     %   None what to do with the result%do nothing, for testing purposes onlyistore the results in HDFS, in the given directory(1), with the given suffix (2), based on the input path.)process all results with the given methoddefinition of input data use given HDFS as starting directory, descend a number of directories from there and take all files starting with the filter prefix (if any given)Hsimple test data, the path is configured, amount of files can be limitedWTask logic definition, most modes expect task mode support, see RemoteExecutionSupport.only transport some of the generated object code and relink remotely (restrictions apply) - the function here is ignored, it only forces the compilation of the contained modulegserialize the given function in the context of the given program, run both as task (restrictions apply)run this binary as task>build the given string as module remotely (restrictions apply),The definition of a distributed calculation.the master hostnamethe master portthe task logicwhich data to processhow to process the result Run a computation.Like hdfsListFiles, but descending into subdirectories and filtering the file names. Note that for now this is a rather a quick hack for special needs than a full fledged shell expansion |           None!%Combines all defined task mode hooks."*Provides support for fullbinary task mode.#0Provides support for serialized thunk task mode.!"# !"#!"#!"#   !"#$%&'()*+,-./01234566789:;<=>?@ABCD E F G H I J K L M N O P Q R S T U V W X Y Z [ \ ] ^ _ ` a b c d e f g h i j k l m n o p q r s t u v wxyz{||}~I      !"task-distribution-0.1.0.36Control.Distributed.Task.Distribution.LogConfiguration.Control.Distributed.Task.Types.HdfsConfigTypes(Control.Distributed.Task.Types.TaskTypes6Control.Distributed.Task.Distribution.TaskDistribution4Control.Distributed.Task.Distribution.RunComputationControl.Distributed.Task.TaskSpawning.DeployObjectCodeRelinked9Control.Distributed.Task.TaskSpawning.SourceCodeExecution2Control.Distributed.Task.TaskSpawning.TaskSpawning initLogginginitDefaultLogging HdfsLocationHdfsPath HdfsConfigTask TaskResult TaskInputstartSlaveNodeexecuteDistributedshowSlaveNodesshowSlaveNodesWithDatashutdownSlaveNodes ResultSpecDiscard StoreInHdfsCollectOnMasterDataSpec HdfsDataSpecSimpleDataSpecTaskSpecObjectCodeModuleDeploymentSerializedThunkFullBinaryDeploymentSourceCodeSpec MasterOptions_host_port _taskSpec _dataSpecs _resultSpec runMasterwithRemoteExecutionSupport$withFullBinaryRemoteExecutionSupport)withSerializedThunkRemoteExecutionSupportgetFileNamePart splitBasePathwithErrorPrefixwithErrorActionwithErrorHandlingserializeFunction serializedeserializeFunction deserialize TimeStamp serializeTimedeserializeTimeserializeTimeDiffdeserializeTimeDifflogErrorlogWarnlogInfologDebuglogTrace simpleLog calculateHashputgetclearAll getFilePath getHomeDir ResultDef HdfsResult _outputPrefix _outputSuffix _outputZippedReturnOnlyNumResultsReturnAsMessageDataDefPseudoDB_pseudoDBFilePathHdfsData_hdfsInputPathTaskDefObjectCodeModule _objectCodeUnevaluatedThunk_unevaluatedThunkPreparedDeployFullBinary_preparedFullBinaryHashDeployFullBinary _deployableSourceCodeModule _moduleName_moduleContent$fSerializableResultDef$fBinaryResultDef$fSerializableDataDef$fBinaryDataDef$fSerializableTaskDef$fBinaryTaskDef Describabledescribe$fDescribableDataDef$fDescribableTaskDef IOHandlingpackIOHandlingunpackIOHandling splitOnExpect packDataDef unpackDataDef packResultDefunpackResultDef time-1.4.2Data.Time.Clock.UTCNominalDiffTimeDistributionStrategyAnywhereIsFineFirstTaskWithData Configuration_maxTasksPerNode _hdfsConfig _pseudoDBPath_distributionStrategy _taskLogFile_sourceCodeDistributionHome_sourceCodeModules_objectCodePathOnMaster_packageDbPath_objectCodeResourcesPathSrc_objectCodeResourcesPathExtragetConfiguration getConfig listFileslistBlockDistribution groupCountrunHdfsWithConfig BlockCountHdfsHitfindNodesWithData readHostNames nodeMatchermergesortOnPrepareSlaveResponsePreparationFinishedPrepareSlaveRequestQuerySlavePreparationResponse UnpreparedPreparedQuerySlavePreparationRequestTransportedResult_transportedResultMetaData_transportedTotalRemoteRuntime_transportedTotalTasksRuntime_transportedResults TaskMetaData _taskName _slaveNodeId_taskDistributionStartTime TaskTransport_masterProcess _taskMetaData_taskDef _dataDefs _resultDef"$fSerializablePrepareSlaveResponse$fBinaryPrepareSlaveResponse+$fSerializableQuerySlavePreparationResponse%$fBinaryQuerySlavePreparationResponse$fSerializableTransportedResult$fBinaryTransportedResult$fSerializableTaskMetaData$fBinaryTaskMetaData$fSerializableTaskTransport$fBinaryTaskTransportwithEnvwithTempBLFilewithTempBLCFile withTempFileignoreIOExceptionsexpectSilentSuccess expectSuccesscreateTempFilePathserializeTaskInputdeserializeTaskInputparseResultStrictexecuteExternalmeasureDurationreadStdTillEOFsupplyPathWithConfig loadEntries readHdfsFile buildConfig readAllChunks copyToLocalcopyHdfsFileToLocalwithHdfsReaderloadDatarunExternalBinaryfullBinaryExecutionExternalExecutionResultdeployAndRunFullBinarydeployAndRunExternalBinary runSingle emitResultconsumeResultswriteResultsToHdfsdeployAndRunSerializedThunkacceptAndExecuteSerializedThunkserializedThunkExecutionloadObjectCodedeployAndRunObjectCodeRelinkedprocessSourceCodeTasksloadTask loadTaskDefwithTempModuleFileprintInterpreterErrorsayI processTasksTasksExecutionResultexecuteFullBinaryArgexecuteSerializedThunkArgspawnExternalTaskfullBinarySerializationOnMaster$serializedThunkSerializationOnMaster2executionWithinSlaveProcessForFullBinaryDeployment0executionWithinSlaveProcessForThunkSerializationobjectCodeSerializationOnMasterCollectedResultdistributeWorkForNodes_collectedMetaData_totalDistributedRuntime_totalRemoteRuntime_totalTasksRuntime_collectedResults NodeOccupancy NodeConfig slaveTaskquerySlavePreparation prepareSlaveslaveTask__staticslaveTask__sdictquerySlavePreparation__staticquerySlavePreparation__sdictprepareSlave__staticprepareSlave__sdict __remoteTableslaveTaskClosurequerySlavePreparationClosureprepareSlaveClosurertableexecuteOnNodesexecuteOnNodes'printStatistics occupyNode unoccupyNodeinitializeOccupancy collectSinglespawnSlaveProcesshandleSlaveTaskprepareResultsForRespondinghandleQuerySlavePreparationhandlePrepareSlavewithSlaveNodestaskDescriptionhdfsListFilesInSubdirsFiltering buildTaskDefexpandDataSpecmkSourceCodeModuleinitTaskLogging