Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Register
  • Sign in
  • H Hercules
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Metrics
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • admireadmire
  • Hercules
  • Merge requests
  • !1

added block size and storage size as data server CLI options

  • Review changes

  • Download
  • Email patches
  • Plain diff
Open Javier Garcia Blas requested to merge malleability into main 2 years ago
  • Overview 0
  • Commits 442
  • Pipelines 0
  • Changes 144

modified srun.sh to use these new CLI options need to test performance

Loading
Loading

Activity


  • Javier Garcia Blas approved this merge request 2 years ago

    approved this merge request

  • Genaro Juan Sánchez Gallegos added 1 commit 2 years ago

    added 1 commit

    • fdfef251 - Added missing files

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 2 years ago

    added 1 commit

    • a03f8ab9 - Added a configuration file to specify where is the Hercules working directory

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 125 commits 1 year ago

    added 125 commits

    • 8888a960 - Fixed getting file size in Python
    • e6c8ad71 - Fixed 'cat' and 'cp'
    • 44fa8a3e - Fixed 'cp' and 'cat'
    • b81c6167 - Fixed read operation
    • 99cbb6a3 - Update README.
    • f88765f7 - Update README.md
    • 4d1c7d8a - qMerge branch 'master' of https://gitlab.arcos.inf.uc3m.es/admire/hercules into workflow
    • 88b8428d - Merge branch 'workflow'
    • 7cb32dd7 - Created template for coonfig file.
    • 06100446 - Update README.md
    • 31677735 - Added improvements in the Hercules deployment without Slurm
    • 98096f62 - Improvements added to hostfile reading
    • 97d242b3 - Improvements added to Hercules deployment file when there is empty lines in the hostfile
    • 34135573 - Fixed 'ls' to list directories
    • 17b897c3 - Added internal symbolic links
    • 8c7f05a7 - Added more symbolic links
    • 07087362 - Added replication factor in configuration file
    • 95e1b41b - Configuration file sample updated
    • 1bfc7c75 - Updated deployment script
    • 8175ab52 - Fixed 'chmod'
    • 47f796f9 - Fixed 'chmod'
    • 1dac8c4b - fixed replication factor configuration
    • 11f520d4 - fixed multithreaded servers
    • e95edb40 - Merge branch 'workflow' into 'master'
    • 1da7863e - added support to access syscall
    • 744ab982 - Fixed 'cd' command
    • 5faa6348 - Fixed 'cd' command
    • 415f6e97 - Minor changes added
    • 97b833b9 - Fixed 'mv' command
    • d4d7b954 - Fixed 'ls' and 'mv'
    • b1130f01 - Added a function to destroy UCX endpoints
    • 7ceaa455 - Minor changes for 'unlink'
    • d2993986 - Fixed an error with 'getcwd' function call
    • bf89ade8 - Added support for 'pwrite' and 'ftruncate'. Improvements added in 'open'.
    • 977da7cb - Add improvements in the management of file descriptors in the backend.
    • 31b22480 - Add improvements at the backend in the management of the file descriptor when a file is close
    • 98b99191 - Add support to store multiple outcomes of Wacomm
    • 0833a7e2 - Minor optimization added in the backend: function pointers are initialized once.
    • 4aebc274 - Add improvements to 'open' functions, and 'errno' is set at the beginning of every call.
    • 89ae9b79 - Add a memory optimization at the backend, changed the key for the map fd and...
    • 483d84c5 - Add some verifications in the deployment file and backend
    • 0e87e51d - Added support for 'dup' and 'dup2'
    • 1dc28f1f - Add minor corrections in the deployment files
    • 205ade20 - Fix 'access' system call
    • 17297353 - Add a function to get a unique name
    • 6d3f76bb - Add missing files
    • b417d9b2 - Add support for 'mkstemp'
    • c85a965e - Add support for 'fdopen'
    • 8fe5da48 - Stops the deployment script in case of error
    • 005fadec - minor fix
    • c344a7f0 - Add support for 'writev', 'pwritev' and 'fcntl'
    • 3cbcc0de - Add minor changes
    • fdb9c296 - Fix 'ls' command when using multiples data servers
    • fa644d5f - Add the 'ATACHED' option in the configuration file, add a minor optimization...
    • e57af5bc - Fix an issue for a block size bigger than 32Mb in the front end
    • 0e364339 - Add memory optimization for the buffers used to receive data, and fix an issue...
    • fa33b375 - Add a function of the general write behaviour
    • 1870a2f2 - Add a minor fix to the deployment script
    • 0105c2f4 - Add support for 'lseek64'
    • f938bbfd - Fix an issue in the search of file descriptors in the map on the front end
    • f73f6ffd - Add support for 'rewind', 'fseek', and 'feof' calls, now a file can be moved...
    • 033e1fde - Add a condition in the backend to ensure parameters are valid ('d' for data or...
    • 24417c88 - Add improvements on the Hercules deployment script, add improvements to...
    • f0da4013 - Add improvements on the fork and read functions
    • b588576c - Add an ucx wait for write operations
    • 33d128aa - Add improvements for remove files
    • 5749ac8c - Updated hercules script
    • d3295dba - Added server demo container
    • 34324108 - Added flag files
    • 2cd5dee6 - Merge branch 'workflow'
    • d7f51a8e - Added meta stat file
    • 3b3d8ede - Added meta stat file
    • 60b36363 - Merge branch 'workflow'
    • 749e08cd - Added dockerfiles
    • d50e3dac - Added working dockerfiles
    • 91b81231 - Add improvements on the frontend
    • 0fabe443 - Add improvements to support relative paths
    • a0450659 - Add support to 'openat', and add improvements for relative paths
    • 7f1fdadd - Merge from 'master' to 'workflow'
    • 83930c50 - Fix an bug when listing subdirectories
    • 12e78b51 - Add improvements to remove files and directories
    • 494769d4 - Minor fix on the backend
    • 693635f5 - Add improvements on the frontend and backend, and fix the close and delete operations.
    • 00190261 - Add improvements on the communication and fix minor bugs
    • 02e3b87b - Add improvements to 'du' command
    • 18c8e51e - Add improvements on the deployment script, add more details when debug is...
    • 2454bd01 - Add general improvements
    • 80dbc9e0 - Updated Spack package description
    • cdc199aa - Added include for compability.
    • 476e3a36 - Add needed files for spack
    • 4eabd2b8 - Merge branch 'master' of https://gitlab.arcos.inf.uc3m.es/admire/hercules
    • 383aa3fd - Added isolated repo for hercules.
    • 7ee48f5b - Added structure use case
    • 98fcca13 - Add general improvements for the deployment file and the frontend
    • d32d9f40 - Merge branch 'master'
    • 58ba6ea4 - Add needed files for spack
    • eb4290db - Set a dependency with UCX 1.14.0 in Spack
    • 7d808df4 - Add use cases
    • 5043ffca - Add support for 'readv'
    • 50acd874 - Add scripts to run IOR tests
    • 430d1d92 - Fix an issue for collective files
    • a54d69a1 - Merge with Debug branch and add testing scrips for IOR
    • 97ef5c16 - Update package.py
    • 26d14995 - Add improvements
    • 67f1549a - Merge branch 'master' of https://gitlab.arcos.inf.uc3m.es/admire/hercules
    • 383a742f - Fix an issue in UCX when using Horovod
    • e5cb0ef6 - Add improvements to 'read' call
    • fafc9196 - Add improvements on the deployment script
    • 5975d356 - Add support for bigger mount points' names
    • 0a1b793a - Add general improvements
    • c4273abd - Add improvements for threads
    • 55402a0d - Add improvements for threads and deletes unused functions
    • a72fb005 - Dispatcher listening on all interfaces.
    • 49d5940e - Add error handling when a socket fails
    • 8699f576 - Add improvements when deleting files.
    • fd5b147f - Add minor improvements for directories.
    • 143cf8c2 - Add improvements on the front-end.
    • 6a352be8 - Add improvements on the back-end.
    • 16c8bd48 - Add improvements on the back-end.
    • 2b5032c0 - Add improvements in unlink.
    • 7152a2e1 - Add minor changes.
    • 99e52a81 - Add improvements related to how endpoints are closed, how Hercules is stopped,...
    • 5b26c5b8 - Add support for 'fprintf' and add improvements to 'fopen'.
    • b2956cf8 - Add 'SLOG_READ' debug option.
    • bc12876a - Adds a 'status' flag for HERCULES instances to know if a dataserver is running.

    Compare with previous version

    Toggle commit list
  • Genaro Juan Sánchez Gallegos added 4 commits 11 months ago

    added 4 commits

    • ac70771b - Add improvements to reduce the number of servers on runtime.
    • 82f5ccc6 - Add malleability improvements to stop servers with the Hercules scripts.
    • 48b29930 - Add malleability enhancements to specify how many nodes are decommissioned.
    • b00f709d - Add improvements for malleability in the front-end.

    Compare with previous version

    Toggle commit list
  • Genaro Juan Sánchez Gallegos added 1 commit 11 months ago

    added 1 commit

    • 40d375a6 - Add an optimization on the backend.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 2 commits 11 months ago

    added 2 commits

    • e675db33 - Add minor changes.
    • da4db187 - Add minor changes.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 11 months ago

    added 1 commit

    • e3cfd9fd - Add malleability improvements for comissioning and fix a minor issue with...

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 10 months ago

    added 1 commit

    • 2b0386c4 - Add improvements in the deployment script.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 10 months ago

    added 1 commit

    • c82887f2 - Add improvements in the deployment script for decommissioning.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 9 months ago

    added 1 commit

    • 9ac9fcd1 - Add improvements in the deployment script to stop the system and add comments in the backend.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 9 months ago

    added 1 commit

    • f34f1488 - Add improvements to distribution policies.

    Compare with previous version

  • Genaro Juan Sánchez Gallegos added 1 commit 9 months ago

    added 1 commit

    • 513796e5 - Add a major improvement in the front end.

    Compare with previous version

Please register or sign in to reply
0 Assignees
None
Assign to
0 Reviewers
Request review from
Labels
0
None
0
None
    Assign labels
  • Manage project labels

Milestone
No milestone
None
None
Time tracking
Lock merge request
Unlocked
participants
Reference:
Source branch: malleability