Skip to Main Content
IBM System Storage Ideas Portal


This portal is to open public enhancement requests against IBM System Storage products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas
  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Status Needs more information
Created by Guest
Created on May 2, 2024

Parallelization/enhancement of pool migrations of individual large files

When running migrations between different pools often it appears the tail latency of the ILM run is dictated by a small number of large files

This seems to be due to the pool migration of any individual file being a single threaded activity that is run in batches.

It also appears possible that it is significantly faster to create a new file via dd than a migration of that file via mmchatter -P

Idea priority Low
  • Guest
    Reply
    |
    May 10, 2024


    size

    dd if=/dev/zero bs=1M count=N

    mmchatter -P capacity

    1MB

    0m0.023s

    0m0.003s

    10MB

    0m0.008s

    0m0.059s

    100MB

    0m0.078s

    0m0.367s

    1GB

    0m0.683s

    0m3.710s

    10GB

    0m6.270s

    0m33.918s

    100GB

    0m59.904s

    4m30.547s

    1TB

    9m21.765s

    55m47.335s


    This moves the files from an NVMe tier of a 3500 to the HDD tier. I don't currently have a system with two NVMe pools to validate this as a migration speed limitation and not a media limitation. Number of files is probably not a limiting factor here as you can apply a policy sorted by file size so the batches will generally run at similar speeds until you have a large outlier file that will take an outsized amount of time in a batch, typically the final batch if sorted. However it does appear migrations are slower than they could be on the whole given this table.


  • Admin
    THOMAS O'BRIEN
    Reply
    |
    May 10, 2024

    Can you please give us information on number of files and files sizes.