SDMX Users Forum

Please login or register.

Login with username, password and session length
Advanced search  


Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Topics - JamesGardner

Pages: [1]
I am in the process of porting my java SDMX parser over to JavaScript.. here is a little demo using the OECD service and pure javascript;
 James Gardner

SDMX 2.1 Public review / SDMX-Json Question
« on: October 26, 2015, 08:46:41 AM »
I have a question about the sdmx-json spec...
in the spec, there is an annotations array, this array can contain multiple annotations,

in sdmx-ml, annotations can be attached to either dataset, series or observation,

in sdmx-json is the fact that an annotation attached to an observation lost in the translation from sdmx-ml to sdmx-json? I can't see any way to put in the sdmx-json that the annotation is attached to an observation?? all the annotations are grouped together in the array with no field on the observation to denote that a particular annotation is associated with that observation?

Thanks in advance for clearing things up for me..

Here are some statistics from the International Labour Organisation on unemployment around the world...
in English, French and Spanish
I think this is unique because the browser's Accept-Language header is used to choose the language of the visual...

I have added a database to my SDMX visualisation.. and now you can save and load visualisations, search by categories... at this page..

I am interested in feedback..
   James Gardner

Hi All!
I just thought i would post to show you a prototype i just put on SourceForge..
it allows you to browse the public SDMX services (ABS, OECD, IMF)..
it can discover a list of the datasets on the server..
download the structure of a dataset,
and then you can filter the dataset by the dimensions of the dataset...(single value, multiple values, or all)
then you can query, and it will show you a tabular form of the data you just selected...
(substituting names of the codes for the 'id's of the data)...

it is located here;

it is my test prototype for opening sdmx documents..
   James Gardner

SDMX Tools, technical implementations and case studies / Sdmx-Sax Tool
« on: August 13, 2013, 06:00:13 AM »
I'm still working sporadically on sdmx-sax, a Java parser to get data out of an SDMX service...
It can query a REST registry for data structures, and query SOAP 2.0 services for Data Structures,
(list data structures, and dump some basic information from them)
once it has the DSD, it can go through all a 'DataMessage's values, and swap Strings for CodeType objects..
I'm just working on doing some basic queries now..
the basic premise of sdmx-sax is to try and keep things modern, ie - sdmx 2.1, so sdmx 2.0 structures are shoe-horned into an sdmx2.1 object model...
it's new home is at

this is some example code querying a SOAP service;
    public void testABSList() throws IOException {
        Sdmx20SOAPQueryable queryable = new Sdmx20SOAPQueryable("ABS", "");
        QueryableServiceRegistry registry = new QueryableServiceRegistry(queryable);
        List<DataStructureReferenceType> list = registry.listDataSets();
        Iterator<DataStructureReferenceType> it = list.iterator();
            DataStructureReferenceType ref =;
            DataStructureType ds = registry.findDataStructure(ref.getRef().getAgencyId(), new IDType(ref.getRef().getId().toString()),ref.getRef().getVersion());
This code queries the ABS sdmx service for data structures (returned as a list of DataStructureReferences)
then loads the DataStructure, and dumps a little bit of information about the DataStructure to System.out

It can also piece together a complete set of dependant Codelists and ConceptSchemes from
when a datastructure is retrieved from the RESTful service...

   James Gardner

Technical Specifications / ConceptRefType
« on: June 24, 2013, 04:09:36 AM »
ConceptRefType seems to be designed for ConceptTypes to be packaged into ConceptSchemes
(there is a field 'maintainableParentID' that is required, and the codelisttypes point to 'Concept/conceptscheme'), however it is possible for concepts to live as identifiable types inside the <Concepts> tag..  (quite where they get their AgencyId and version i haven't figured out, since they don't extend MaintainableType at all)
I am trying to convert the sdmx 2.0 sample 'StructureSample.xml' into an sdmx 2.1 file.. and i am having problems thinking about what to do with the Concepts... I need the ConceptReference for the dimensions' ConceptReference... and ConceptReferences cannot point to maintainable artefacts.. only ConceptSchemes...
also.. ConceptRefType seems to be missing an AgencyID...
   James Gardner

Technical Specifications / MetadataStructureRefType
« on: February 19, 2013, 10:46:25 PM »
for MetadataStructureRefType, the type is constrained to only have a class and package target..
From SDMXCommonReferences.xsd
         <xs:documentation>MetadataStructureRefType contains a set of reference fields for a metadata structure definition.</xs:documentation>
         <xs:restriction base="StructureRefBaseType">
            <xs:attribute name="class" type="StructureTypeCodelistType" use="optional" fixed="MetadataStructure"/>
            <xs:attribute name="package" type="StructurePackageTypeCodelistType" use="optional" fixed="metadatastructure"/>
what field am i supposed to use to resolve this reference into a MetadataStructure when there's no Agency, ID, Version, or URN field on this type?
or is MetadataStructureRef just supposed to indicate that the target object is a Metadatastructure??
   James Gardner

Technical Specifications / Dataflow Constrained?
« on: November 10, 2011, 12:13:45 AM »
Dataflow is supposed to be able to be constrained, however in SDMXStructureDataflow.xsd the DataflowType does not contain a ConstraintType Element, however i notice that in the ECB SDMX service...
the dataflow has a Constraint element i cannot access through XMLBeans...
(neither 2.0, or 2.1 has a constraint element)...
has anyone been able to access the Constraint in a dataflow with XMLBeans? or with OpenSDMX?
   James Gardner


I'm trying to parse these two files... and there are 2 observations in the demography_xs.xml file
line 45 and 46, character 25
         <Obs xsi:type="demo:LBIRTHST" OBS_STATUS="M" UNIT_MEASURE="PERS" UNIT_MULT="0"/>
         <Obs xsi:type="demo:DEATHST" OBS_STATUS="M" UNIT_MEASURE="PERS" UNIT_MULT="0"/>
that do not have OBS_VALUE fields in them... if an observation doesn't have a primary measure.. should i just ignore the observation??
    James Gardner

Hi... looking through SDMX 2.0 specification...
StructureSample.xml has a 'TimeDimension' with a ConceptRef="TIME" with 'crossSectionalAttachGroup=true..
but no <structure:AttachmentGroup>
CompactSample.xml  Observations have a Dimension (TIME_PERIOD) that is not described in the MSD...
am i missing something???
    James Gardner

i'm working on a Java SDMX Abstraction API... it uses OpenSDMX to validate an abstract pojo model... (and all properties are constained)...

very early in development now... but can parse a compactdata, abstract it it's object model.. modify a property, and save it again...
i'm aiming for it to be strongly typed... and any method call that violates the MSD (is planned) to raise an exception, and rollback gracefully.. (well.. as gracefully as i can manage without using a transaction... which is why lots of things are done in a single method call..)

Pages: [1]