HPC system storage help

@sajjadtaghvaeifr

Hello, I trust you're doing well. I am well experienced in machine learning algorithms, with nearly a decade of hands-on practice. My expertise lies in developing various artificial intelligence algorithms, including the one you require, using Matlab, Python, and similar tools. I hold a doctorate from Tohoku University and have a number of publications in the same subject. My portfolio, which showcases my past work, is available for your review. Your project piqued my interest, and I would be delighted to be part of it. Let's connect to discuss in detail. Warm regards. please check my portfolio link: https://www.freelancer.com/u/sajjadtaghvaeifr

@softsolution2000

I have extensive experience in Java, Python, Linux, Troubleshooting, and Network Administration, making me a great match for the HPC system storage help project. I am confident in my ability to lead the integration of advanced storage solutions with compute clusters using cutting-edge technologies. Once we discuss the full scope, we can adjust the budget accordingly. Please review my 15-year-old profile to see my past work. Let's discuss the job details and get started right away. I am ready to showcase my commitment by starting work before being hired. Looking forward to your response.

@masummsnr

Hi there, I am an experienced storage and HPC systems engineer with strong expertise in integrating advanced storage solutions with compute clusters using technologies such as InfiniBand, Slingshot, and Ultra Ethernet. I can design and implement multi-PB storage systems with parallel file systems like Lustre or Spectrum Scale, optimize NVMe-oF and tiering strategies, and automate workflows using Python and Bash. Let's connect to discuss your project in detail. Regards, Masum

@sydneylabs

Hi There, I have experience in all the stuff you have mentioned, including VAST, DDN, Lustre, NFS, NVME. If you are serious about your setup, please ping me. Thanks

@aig

Hailing from XtrazCon Technology Pvt. Ltd with a comprehensive understanding of how modern storage solutions work, I bring to the table a unique blend of expertise and experience that make me perfectly suited for your project. For two decades in the IT industry, my journey amounts to a whopping 47 years of combined learning and problem-solving – something I believe you need in your candidate. From designing and implementing storage systems at a multi-PB scale with cutting-edge file systems to profound knowledge of Linux administration and parallel protocols, I have mastered every aspect crucial for this project's success. Additionally, my familiarity with renowned vendor solutions like VAST, WEKA, DDN, and Spectra Logic makes me adept at mapping out tailored solutions that adhere precisely to your storage needs. Moreover, my skills in Python and Bash allow me to automate your HPC system's processes intelligently. That's not all; adept at Java too, I understand the crucial role of high-speed networking technologies within HPC clusters which will further come in handy for this endeavor. It's safe to say, hiring me will ensure streamlined operations and quality outcomes even with the most intricate challenges your project might pose. Don't settle for an average choice: choose excellence—choose XtrazCon Technology Pvt. Ltd!

@sadam61

Hi there, I’m eager to assist you with the HPC system storage integration project. With over 9 years of experience in advanced Python development and strong expertise in integrating storage solutions with compute clusters, I am confident in designing the essential performance tuning strategies and parallel file systems like Lustre or Spectrum Scale. My background encompasses Linux administration and extensive work with NVMe SSDs and high-capacity disk arrays, alongside a deep understanding of networking technologies, including InfiniBand and Ultra Ethernet. I have successfully executed multi-PB scale storage systems and can bring that experience to your project for optimal results. I’m ready to start immediately and am looking forward to contributing to your success.

@Hemantt841

With 7 years of experience in the field, I am the best fit to lead the integration of advanced storage solutions with compute clusters for the HPC system storage help project. I have the relevant skills and expertise to design and implement storage systems at multi-PB scale with state-of-the-art parallel file systems. How I will complete this project: - I will start by analyzing the requirements and designing a storage solution that integrates advanced networking technologies such as InfiniBand, Slingshot, and Ultra Ethernet. - I will leverage my expertise in storage performance tuning to optimize NVMe-oF, metadata management, and tiering strategies. - I will utilize my comprehensive knowledge of Linux administration, storage hardware, and protocols to implement a robust storage system. - I will integrate parallel file systems like Lustre or Spectrum Scale to ensure efficient data storage and retrieval. Tech stack I will use: - Linux administration - NVMe SSDs and high-capacity disk arrays - NFS, Lustre, S3 protocols - Python, Bash scripting for system automation - High-speed networking technologies I have worked on similar solutions in the past, showcasing my ability to successfully integrate storage solutions with compute clusters in HPC environments. My experience and expertise make me the perfect candidate to deliver a high-quality and efficient storage system for this p

@Nilosiqueiratj

Hi, I reviewed your project about "HPC system storage help" and noticed that you're working with parallel file systems like Lustre and Spectrum Scale. That tells me the main challenge here is optimizing storage performance and seamless integration with high-speed networking technologies in HPC environments. I’ve worked on similar HPC infrastructure projects where I: - designed scalable backend APIs, - implemented secure authentication and data models, - and delivered production-ready web/mobile features. For your project, I’d suggest starting with a thorough assessment and tuning of NVMe-oF storage paths combined with metadata management optimization to avoid future rework and performance issues. Before moving forward, I have one quick question: Which HPC cluster environment and storage vendor solutions are currently in use or planned for integration? If this aligns with your expectations, I can outline a clear implementation plan and timeline right away. Best regards, Nilo

@joelmarkharris

Hello, Leveraging nearly a decade of experience as a software developer, my expertise aligns perfectly with your HPC system storage integration. Not only do I possess comprehensive knowledge of Linux administration and networking technologies like InfiniBand, Slingshot, and Ultra Ethernet, but I also have hands-on experience with parallel file systems such as Lustre and Spectrum Scale. What sets me apart is my understanding of the specific challenges and strategies involving storage performance tuning, metadata management, and tiering at multi-PB scale. I've worked extensively on NVMe-oF configurations, optimizing the speed of data transfer using cutting-edge storage hardware like NVMe SSDs and high-capacity disk arrays. My proficiency in scripting languages like Python and Bash can expedite the automation process for system monitoring and troubleshooting. Throughout my career, I've consistently delivered scalable, high-performance applications while prioritizing long-term maintainability. Whether it's utilizing vendor solutions like VAST or WEKA or designing bespoke architectures tailored to your needs, my ultimate goal is to harness the full power of your compute clusters while ensuring data integrity and accessibility. Let's collaborate to revolutionize your HPC storage systems! Thanks!

@Dmitrydev1

Hi there, I’m confident I can lead the integration of advanced storage with HPC compute clusters, leveraging InfiniBand, Slingshot, and Ultra Ethernet to deliver scalable, petabyte-scale storage with top-tier performance. My approach combines NVMe-oF-based architectures, metadata-rich storage tuning, and intelligent tiering to maximize I/O throughput and minimize latency. I have hands-on experience deploying and tuning Lustre and Spectrum Scale in multi-PB environments, along with Linux system administration, NVMe SSDs, large disk arrays, and the core protocols you rely on (NFS, Lustre, S3). From design to deployment, I will: - Architect high-performance storage layouts integrated with state-of-the-art networks and parallel file systems; - Implement performance tuning for metadata handling, caching strategies, and tiering across NVMe and HDD tiers; - Validate and optimize file systems for sustained throughput, low latency, and scalable metadata performance; - Automate provisioning, monitoring, and troubleshooting with Python and Bash to reduce operational toil and speed up recovery. I’ve worked with vendor solutions such as VAST, WEKA, DDN, and Spectra Logic, translating Storage Area Network objectives into reliable HPC-ready deployments. My plan is to deliver a production-ready storage solution within a tight, realistic timeline and with clear documentation for ongoing maintenance. Best regards, Dmytro

@danylop55

Hi there. You need InfiniBand, Slingshot, Ultra Ethernet storage integrated with compute clusters using Lustre or Spectrum Scale, tuned for NVMe over Fabrics and multi PB scale. Success depends on throughput and IOPS targets, metadata profile, topology, and tiering. Pitfalls are RDMA or MTU mismatches, metadata bottlenecks, small file storms, NUMA misalignment, and weak monitoring. First hour I will capture baselines with fio and mdtest, verify driver firmware and switch settings, then draft a tuning and rollout plan for MDS and OSS placement and failover. Which file system and vendor stack are in scope, and what read write targets and node counts should we hit. I provide Python and Bash automation plus a clear runbook for reproducible performance and troubleshooting. Ready to start quickly, happy to chat. Danylo Podolskyi

@SoftTechAmerica

As an experienced digital solutions provider, SoftTechAmerica possesses not only the breadth of knowledge and expertise that your project requires but also the long-lasting commitment to reliable communication and customer satisfaction necessary for the longevity of a project such as this. With 10+ cumulative years of industry intel, our team at SoftTechAmerica has not only established a solid background in storage system integration, parallel file systems, networking technologies, but has also had success integrating them effectively within HPC clusters for optimal performance. Furthermore, we understand that this project requires a strong command over scripting languages like Python and Bash, as well as comprehensive knowledge surrounding Linux administration – both are skills we've diligently built over the years. We have successfully deployed multiple multi-PB-scale storage systems with high-performance parallel file systems utilizing cutting-edge networking solutions, such as InfiniBand and Slingshot, something essential to benefit from the advantages of an NVMe-oF protocol while ensuring metadata management and tiering strategies works smoothly. In conclusion, hiring SoftTechAmerica means locking in not just our expertise in designing and implementing state-of-the-art storage systems that leverage advanced networking technologies, but also accessing clear lines of communication benefiting from our versatility working across different time zones. Let´s contract.

@blazenicholas

I appreciate the opportunity to work on your advanced storage integration project involving InfiniBand, Slingshot, and Ultra Ethernet. Your focus on multi-PB scale parallel file systems like Lustre and Spectrum Scale aligns perfectly with delivering a well-structured, seamless storage and compute cluster environment. I bring expertise in storage performance tuning, Linux administration, and high-speed networking integration. I may be new to Freelancer, but I bring solid experience to the table. I’m happy to offer a free call to discuss how to create a professional, user-friendly solution tailored to your needs. Regards, Blaze Nicholas

@varinder13137

Hi, I am a Senior Java Spring Boot Microservices Developer with 7+ years of experience building secure, production-ready backend systems. I have strong hands-on experience with Java (8, 11, 17, 21) and Spring Boot, working on REST APIs, microservices, and enterprise applications, including fintech and payment systems. I can help you with: • Spring Boot & microservices development • Secure REST APIs (JWT / OAuth2) • Database design & optimization • Bug fixing, performance tuning, and clean architecture I have worked on high-transaction, security-sensitive systems and deliver production-quality code. Quick question: Is this a new project or an existing codebase? Regards, Varinder Kaur

@arunaa62

I am a Java Spring Boot Developer with 3+ years of experience building secure, production-ready backend systems. I have strong hands-on experience with Java (8, 11, 17, 21) and Spring Boot, working on REST APIs and enterprise applications, including payment systems. I can help you with: • Spring Boot & microservices development • Secure REST APIs (JWT / OAuth2) • Database design & optimization • Bug fixing, performance tuning, and clean architecture

@LiamKJ

NO SATISFACTION, NO PAYMENT Your project to integrate advanced storage solutions with compute clusters aims to enhance data throughput and system reliability critical for high-performance computing environments. Failure to execute this with precision risks significant delays, budget overruns, and underperformance that could stunt your infrastructure’s growth and efficiency. I focus on clear communication, taking full ownership of the integration process to ensure smooth implementation and measurable improvements. My approach prioritizes delivering robust storage performance and seamless networking integration tailored to your specific cluster demands. I have successfully led similar high-scale storage and networking integrations outside this platform. I am offering a slightly reduced rate here to establish a trusted long-term partnership, not due to lack of experience. You are not locked into any commitment upfront; early alignment on goals is what matters most. Please reply with any specific concerns or details about your infrastructure so we can ensure a perfect fit before proceeding. Worst case, you walk away with useful clarity on your project. Warm regards, Liam.

@BrijeshSondarva

I'm working on multi layer HPC systems. which include Compute Storage and Network. If you stuck in tuning of HPC fill free to reachout to me i can help to tune your cluster components.