How do I know when it has finished the initial load?

Question:

We just installed and started MetaMiner, how do I know when it has finished the initial load?

Answer:

There are two primary ways to determine whether or not MetaMiner has completed the initial pull:

•	Navigate to the Data Integrity Status Page and review the counts shown and determine if they match up between the CMS and MMDB.

•	The second method involves the Deep Metadata Verification Query, see below. This query verifies that a complete and deep extraction of your BI assets is happening successfully.

For Oracle Database

SELECT count(NBR_DOCS) NBR_DOCS, CMSID, case when error is not null then (error) else '-------' END as ERROR, DATATYPE from (
       select id as NBR_DOCS, CMSID, (to_char(loaderrordesc)) as ERROR, 'DESKTOP_INTELLIGENCE' as DATATYPE from deski_documents
       union
       select id, cmsid, processingerror, 'WEBI_XI3_DEEP_OK'from webi1200_documents wd where exists
               (select null from webi1200_dataproviders wdp where wdp.webi1200_document_id = wd.id)
       union
       select id, cmsid, processingerror, 'WEBI_XI3_DEEP_PARTIAL/OTHER'from webi1200_documents wd where not exists
               (select null from webi1200_dataproviders wdp where wdp.webi1200_document_id = wd.id)
       union
       select id, cmsid, processingerror, 'WEBI_BI4_DEEP_OK'from webi1400_documents wd where exists
               (select null from webi1400_dataproviders wdp where wdp.WEBI1400DOCUMENT_ID = wd.id)
       union
       select id, cmsid, processingerror, 'WEBI_BI4_DEEP_PARTIAL/OTHER'from webi1400_documents wd where not exists
               (select null from webi1400_dataproviders wdp where wdp.WEBI1400DOCUMENT_ID = wd.id)
       union
       select id, cmsid,  processingerror , 'CRYSTAL'from crystal_documents
       union
       select id, cmsid, '-------', 'UNV' from unv_universes unv where exists
               (select null from unv_objects uo where uo.cmsid = unv.cmsid and unv.id = uo.unv_universes_id)
       union
       select id, cmsid, 'Error (Import Failure / Impartial unv objects)', 'UNV' from unv_universes unv where not exists
               (select null from unv_objects uo where uo.cmsid = unv.cmsid and unv.id = uo.unv_universes_id)
       ) A group by CMSID, error, datatype order by error, a.cmsid, datatype

For SQL Server Database

SELECT count(NBR_DOCS) NBR_DOCS, CMSID, case when error is not null then (error) else '-------' END as ERROR, DATATYPE from (
        select id as NBR_DOCS, CMSID, (loaderrordesc) as ERROR, 'DESKTOP_INTELLIGENCE' as DATATYPE from deski_documents
        union
        select id, cmsid, processingerror, 'WEBI_XI3_DEEP_OK'from webi1200_documents wd where exists
                (select null from webi1200_dataproviders wdp where wdp.webi1200_document_id = wd.id)
        union
        select id, cmsid, processingerror, 'WEBI_XI3_DEEP_PARTIAL/OTHER'from webi1200_documents wd where not exists
                (select null from webi1200_dataproviders wdp where wdp.webi1200_document_id = wd.id)
        union
        select id, cmsid, processingerror, 'WEBI_BI4_DEEP_OK'from webi1400_documents wd where exists
                (select null from webi1400_dataproviders wdp where wdp.WEBI1400DOCUMENT_ID = wd.id)
        union
        select id, cmsid, processingerror, 'WEBI_BI4_DEEP_PARTIAL/OTHER'from webi1400_documents wd where not exists
                (select null from webi1400_dataproviders wdp where wdp.WEBI1400DOCUMENT_ID = wd.id)
        union
        select id, cmsid,  processingerror , 'CRYSTAL'from crystal_documents
        union
        select id, cmsid, '-------', 'UNV' from unv_universes unv where exists
                (select null from unv_objects uo where uo.cmsid = unv.cmsid and unv.id = uo.unv_universes_id)
        union
        select id, cmsid, 'Error (Import Failure / Impartial unv objects)', 'UNV' from unv_universes unv where not exists
                (select null from unv_objects uo where uo.cmsid = unv.cmsid and unv.id = uo.unv_universes_id)
        ) A group by CMSID, error, datatype order by error, a.cmsid, datatype

initial-load-verificatoin

Nearly all objects came through OK. If you continue to have an issue with partial metadata pulls, please contact Infolytik Support immediately.