IBM System Storage Ideas Portal


This portal is to open public enhancement requests against IBM System Storage products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas

  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Add a new idea Subscribe
Status Not under consideration
Workspace Storage Scale (formerly known as GPFS)
Created by Guest
Created on Mar 11, 2022

RELATED IDEAS

Bandwidth limitations / Traffic shaping / QOS for data communication

Sometimes different clients in a Spectrum Scale cluster have different IO performance requirements, but the options to resolve this by choosing adequate HW are somewhat limited. Consider clients using InfiniBand (RDMA), which will most likely use all the same HCA, but some clients need to have a much lower throughput towards the filesystem than others. Also very important: A subset of all clients should not be able to fully saturate the filesystem, thus leaving the remaining clients without adequate access to the filesystem. It seems there is currently no way to achieve this, but it could be implemented via the NSD servers which could effectively implement QOS. Other clustered filesystems provide means to implement this, e.g. Lustre has TBF to virtually guarantee clients some throughput.
Idea priority Medium
  • Guest
    Reply
    |     Jan 9, 2023
    Here's a brief background on our file system QoS: it is throttling the I/O requests to disks at client node, so would throttle the data load to the NSD server nodes. That means we don't throttle the network load resulted from other RPC messages, and also don't throttle the network load between clients and clients (but suppose we don't have big workload between client nodes). About the QoS class, we have both file system and fileset level classes. For file system level class, ???maintenance" and ???other" are visible to end users, while for fileset QoS classes, it is defined by users. This will give user flexibility to throttle I/Os in the entire file system or at some particular filesets. In addition, the throttle configuration for both types of QoS classes can be per node, or node class, or cluster. That means users can select to throttle I/Os from a subset of nodes or have different throttling configurations for different nodes (or clusters).

    ----> Please check the usage and man page for the mmqos command, and note that this is at a high layer QoS than the network layer QoS. If this does not satisfy your requirement please open a new RFE with additional detail on the use case
  • Guest
    Reply
    |     Apr 13, 2022

    Meanwhile i learned that Spectrum Scale 5.1 and later provides mmqos which enables part of our idea. However this is currently limited in not providing bandwidth limitation for Clients using O_DIRECT and is only usable for filesets. We would like to see this expanded to enable clients to just use a configured bandwidth without being able to exceed that limit, it should not be limited to filesets or general classes. Another option would be to be able to implement 'client classes' for general fs access.


    Best regards,

    Thomas

  • Guest
    Reply
    |     Apr 13, 2022

    Thank you for submitting this Idea for Spectrum Scale. We will review this request and see if it is something we can implement in the near future.


    Sincerely,

    Spectrum Scale team

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.