Identifying unused data in Azure table storage and deleting it

vishnukumarjagathessan-7388 0 Reputation points
2024-07-24T05:01:46.6033333+00:00

There are 100 TB of data in Azure table storage in a particular storage account, and I need to identify which is in use and which needs to be deleted. Could you perhaps offer a solution to accomplish this?

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
171 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Sumarigo-MSFT 47,101 Reputation points Microsoft Employee
    2024-07-24T07:40:48.5566667+00:00

    @vk Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

    To identify which data in Azure Table Storage is in use and which needs to be deleted, you can follow these steps:

    1. Query the Data: Use Azure Table Storage queries to filter and identify the data that is no longer needed. You can perform queries based on timestamps or other relevant criteria to find data that is outdated or unused.
    2. Delete the Data: Once you have identified the data to be deleted, you can use batch operations to delete multiple entities at once for efficiency. If the entire table is no longer needed, you can delete the table itself, but keep in mind that this action is irreversible and the table cannot be used or recreated until the deletion process is complete.
    3. Automation: Consider automating the process with Azure Functions or Logic Apps to periodically check and clean up unused data based on your business rules.
    4. Monitor: Regularly monitor your storage account to keep track of data usage and potential savings from deleting unused data

    We have articles which provided detailed information how to identify unused Storage account
    Monitoring your storage service with Azure Monitor Storage insights Check the column transactions It is by default ordered by highest usage. If you want to see the utilization, use the capacity tab!

    Monitor Azure Table Storage :
    Identify the data that is being used: You can use Azure Monitor to identify the data that is being used. Azure Monitor provides insights into the performance and usage of your Azure resources. You can use Azure Monitor to monitor the read and write operations on your Azure Table Storage account. This will help you identify the data that is being used and the data that is not being used.

    Find/list the Unused storage accounts in azure using powershell

    Please let us know if you have any further queries. I’m happy to assist you further.    


    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.