dschulten / hydra-java

Annotate your Java beans and serialize them as json-ld with hydra
Apache License 2.0
107 stars 27 forks source link

= hydra-java image:https://travis-ci.org/dschulten/hydra-java.svg?branch=master["Build Status", link="https://travis-ci.org/dschulten/hydra-java"] :toc: :toc-placement: preamble

Annotate your Java beans and serialize them as http://www.w3.org/TR/json-ld/[json-ld] with http://www.hydra-cg.com/spec/latest/core/[hydra].

Status: Testing. Since the Hydra Specification is still a draft, expect incompatible changes.

Latest release: 0.4.1

== Problem

The meaning of json attributes in api responses, their possible values etc. is usually not obvious without referring to some information coming from outside the resource itself. That is due to the nature of json. Two solutions immediately come to mind. Both are ways of vendor-specific documentation, some are machine-readable, some aren't.

Describe the type in some sort of json-schema, wadl, raml, swagger or similar and publish it together with the resource. People could even generate classes from this information, if they wish to. My api users coming from a wsdl background scream for something like that.

Or put up documentation pages to describe your ex:doodad extension relation types and make the documentation available by dereferencing http://example.com/api/rels#doodad.

But one of the rules for a ReSTful API is:

[quote, Roy Fielding]


A REST API should never have “typed” resources that are significant to the client. Specification authors may use resource types for describing server implementation behind the interface, but those types must be irrelevant and invisible to the client. The only types that are significant to a client are the current representation’s media type and standardized relation names. [Failure here implies that clients are assuming a resource structure due to out-of band information, such as a domain-specific standard, which is the data-oriented equivalent to RPC's functional coupling].


My interpretation of this famous http://roy.gbiv.com/untangled/2008/rest-apis-must-be-hypertext-driven[rant by Roy Fielding]:

A publicly available media-type should give clients all necessary means to interpret a server response, and relation names for hyperlinks in the response must be recognizable based on public conventions, so that the client can act upon the responses it receives without knowing the details of a vendor-specific api.

In other words: If a client is told to make a reservation for a concert ticket, it should be able to recognize what one-fancy-api requires to achieve that without processing a vendor-specific documentation. How can we do that, purely based on a media type and relation names? Do we need hundreds of iana registered media types for all kinds of purposes?

== Solution (evolving)

I see http://www.w3.org/TR/json-ld/[json-ld] (media type application/ld+json) as a possible way to solve this problem without forcing people to ask me about my vendor-specific documentation, thus decoupling the clients from my server types.

Clients should be able to understand a response based on widely available, standardized, public information.

The json-ld mediatype allows to bring descriptions of things in the real world from public vocabularies into your json files. With json-ld there is a way to say that a json response describes a http://schema.org/MusicEvent[MusicEvent] which http://schema.org/offers[offers] a http://schema.org/Ticket[Ticket] without any vendor-specific documentation, and it can also link to other resources.

A popular vocabulary which describes things on the internet is http://schema.org. It is used by all major search engines for search engine optimization and sufficient for basic needs. It also integrates with other vocabularies, e.g. by using http://schema.org/additionalType[additionalType] to point to http://purl.org/goodrelations/[GoodRelations] classes or by using external enumerated values as shown by http://schema.org/DeliveryMethod[DeliveryMethod].

(For those of you about to say that the Semantic Web never took off, please note that json-ld is http://manu.sporny.org/2014/json-ld-origins-2/[not about the Semantic Web at all]).

http://www.hydra-cg.com/[Hydra] adds interaction to the mix. It describes exactly how to post a ticket reservation.

So I want to add json-ld information to json objects serialized from my Java beans.

Java beans have no knowledge about the meaning of their bean properties and they do not know what they represent in the real world.

In the simplest possible case I want to design my json objects so that they can be understood by others based on schema.org. By simply calling my json transfer class Person and letting it have an attribute name, I want to get a publicly understandable json object, like this:

[source, Java]

@Test
public void testDefaultVocabIsRendered() throws Exception {

    class Person {
        private String name = "Dietrich Schulten";

        public String getName() {
            return name;
        }
    }

    mapper.writeValue(w, new Person());
}

The corresponding json-ld object, written by hydra-java:

[source, Javascript]

{ "@context": { "@vocab": "http://schema.org/" }, "@type": "Person", "name": "Dietrich Schulten" }

Note that I do not bind my clients to a server type Person. Rather, client and server are talking about the thing http://schema.org/Person[Person] as it is known and recognized by all major search engines.

For a more expressive example consider the json-ld example of http://schema.org/MusicEvent[MusicEvent], which shows how a ticket offering could look like.

In a more complex scenario I want to use my own attribute names and object design and still be able to use schema.org or other vocabs to describe their meaning. In json-ld I can. See below for a listing of vocabularies.

== First Steps It is currently possible to render responses from a https://github.com/spring-projects/spring-hateoas[spring-hateoas] service based on Spring MVC with various message converters.

Look into the https://github.com/dschulten/hydra-java/blob/master/hydra-sample/service/src/main/java/de/escalon/hypermedia/sample/Config.java[sample configuration] to see how you can set up the hydra message converter, but also the XHTML message converter and the Siren message converter with Spring MVC. The tests in https://github.com/dschulten/hydra-java/blob/master/hydra-jsonld/src/test/java/de/escalon/hypermedia/hydra/serialize/JacksonHydraSerializerTest.java[JacksonHydraSerializerTest] demonstrate the usage of @Vocab, @Expose and @Term.

== Features of hydra-spring The conversion of a spring-hateoas Resource to hydra does the following:

As of version 0.2.0 hydra-java supports hydra:collection, hydra:operation and hydra:IriTemplate as well as reversed terms. To make this possible, you must use the linkTo and methodOn methods of AffordanceBuilder as a drop-in replacement for ControllerLinkBuilder. Templated links created by ControllerLinkBuilder will at least be rendered as IriTemplates, but only with limited information about the template variables.

Furthermore, if you use these hydra features, make sure you have a @Term(define = "hydra", as = "http://www.w3.org/ns/hydra/core#") annotation in your context.

== Examples

=== Designing a Hydra API === See my article https://www.w3.org/community/hydra/wiki/Restbucks_with_Hydra[Restbucks with Hydra] for an example of an ordering flow.

=== Live Demo

Use a ReST client to access a http://jbosswildfly-escalon.rhcloud.com/hypermedia-api/events[Sample Events API] to see the artifact hydra-sample at work. There is also a http://jbosswildfly-escalon.rhcloud.com/hypermedia-api/store[Sample Shop] which demonstrates the ideas from the Restbucks with Hydra article. OpenShift sometimes completely shuts down the container, please try several times if you run into server errors when first accessing the sample. As an alternative, @damnhandy has provided https://github.com/damnhandy/hydra-springboot[hydra-springboot].

Browsers will show the html representation of the API by default, which uses the XhtmlResourceMessageConverter. Sending Accept: application/ld+json will get you hydra, but application/json or application/hal+json work as well. When you POST or PUT, make sure you add a Content-Type header matching your request.

=== Exposing Java Bean Attributes

Assuming a Java enum whose enum values are exposed as values from GoodRelations and which appears on an Offer object with GoodRelations term:

The example shows a Java enum named `BusinessFunctionˋ whose enum values are exposed as values from GoodRelations. The enum appears on an Offer object with a GoodRelations term:

[source, Java]

enum BusinessFunction {
    @Expose("gr:LeaseOut")
    RENT,
    @Expose("gr:Sell")
    FOR_SALE,
    @Expose("gr:Buy")
    BUY
}

@Term(define = "gr", as = "http://purl.org/goodrelations/v1#")
class Offer {
    public BusinessFunction businessFunction;
    ...
}

The json-ld output written by hydra-java makes the GoodRelations url known under the shorthand gr, says that the businessFunction property contains values defined by a vocabulary and maps the Java enum value RENT to its linked data name "gr:LeaseOut".

[source, Javascript]

{ "@context": { "@vocab": "http://schema.org/", "gr": "http://purl.org/goodrelations/v1#", "businessFunction": {"@type": "@vocab"}, "RENT": "gr:LeaseOut" }, "@type": "Offer", "businessFunction": "RENT" }

=== AffordanceBuilder for rich hyperlinks

A hypermedia affordance is a rich hyperlink. That means, it not only contains a URI or a URITemplate, but also information about the usage of the URI, such as supported http methods and expected parameters. The term 'hypermedia affordance' is a neologism made popular by http://amundsen.com/blog/archives/1109[Mike Amundsen], following an earlier reference in http://roy.gbiv.com/talks/200804_REST_ApacheCon.pdf[A little REST and Relaxation] by Roy Fielding. A hydra-java Affordance can be used to render media-types which support this kind of information: first and foremost hydra, but it is quite easy to add message converters for other media types once the basic information is available.

Version 0.2.0 provides an AffordanceBuilder class which is a drop-in replacement for the spring-hateoas ControllerLinkBuilder.

The AffordanceBuilder does not depend on hydra or json-ld. It lives in the standalone jar spring-hateoas-ext and can also be used to render other media types than json-ld. It has support for all HAL link attributes when rendered as HAL, and can also be rendered as Siren or XHtml using message converters from spring-hateoas-ext.

See <> for the maven coordinates of spring-hateoas-ext.

Use the AffordanceBuilder to build Affordance instances which inherit from the spring-hateoas Link but add the following traits to it:

Use the enhanced builder API of AffordanceBuilder to add more link params than allowed by Link:

[source, Java]

AffordanceBuilder.linkTo(methodOn(Foo.class).getBars()).rel("bars") // rel() instead of withRel() .withType("text/html") .withLinkParam("name", "red-bar") // adding HAL name attribute .build();

In the following we use AffordanceBuilder to add a self rel that can be used with GET, PUT and DELETE to an event bean. First we wrap the event into a Resource so we can add affordances to it. Then we use the linkTo-methodOn technique three times to describe that the self rel can be used to get, update and delete the event.

[source, Java]

import static de.escalon.hypermedia.spring.AffordanceBuilder.linkTo;
import static de.escalon.hypermedia.spring.AffordanceBuilder.methodOn;

@Controller
@RequestMapping("/events")
public class EventController {

    @RequestMapping(value = "/{eventId}", method = RequestMethod.GET)
    public @ResponseBody Resource<Event> getEvent(@PathVariable Integer eventId) {
        // get the event from some backend, then:
        Resource<Event> eventResource = new Resource<Event>(event);

        // using AffordanceBuilder.linkTo and AffordanceBuilder.methodOn
        // instead of ControllerLinkBuilder methods
        eventResource.add(linkTo(methodOn(EventController.class)
                .getEvent(event.id))
            .and(linkTo(methodOn(EventController.class) // 2nd action with .and
                .updateEvent(event.id, event)))
            .and(linkTo(methodOn(EventController.class) // 3rd action with .and
                .deleteEvent(event.id)))
            .withSelfRel());
        return eventResource;
    }

    @RequestMapping(value = "/{eventId}", method = RequestMethod.GET)
    public @ResponseBody Resource<Event> getEvent(@PathVariable Integer eventId) {
        ...
    }

    @RequestMapping(value = "/{eventId}", method = RequestMethod.PUT)
    public ResponseEntity<Void> updateEvent(@PathVariable int eventId, @RequestBody Event event) {
        ...
    }

    @RequestMapping(value = "/{eventId}", method = RequestMethod.DELETE)
    public ResponseEntity<Void> deleteEvent(@PathVariable int eventId) {
        ...
    }
}

public class Event {
    public final int id;
    public final String performer;
    public final String location;
    private EventStatusType eventStatus;
    private String name;

    public Event(int id, String performer, String name, String location, EventStatusType eventStatus) {
        ...
    }

    public void setEventStatus(EventStatusType eventStatus) {
        this.eventStatus = eventStatus;
    }
}

When rendered with the HydraMessageConverter, the resulting json-ld event object has the corresponding GET, PUT and DELETE operations. The PUT operation expects an http://schema.org/Event[Event] with a property http://schema.org/eventStatus[eventStatus]. By default, writable properties (with a setter following the JavaBean conventions) are rendered as hydra:supportedProperty. The URI to be used by the operations is the @id of the object that has a hydra:operation.

[source, Javascript]

{ "@type": "Event", "@id": "http://localhost/events/1", "performer": "Walk off the Earth", "location": "Wiesbaden", "name": "Gang of Rhythm Tour", "eventStatus" : "EVENT_SCHEDULED", "hydra:operation": [ { "hydra:method": "GET" }, { "hydra:method": "PUT", "hydra:expects": { "@type": "Event", "hydra:supportedProperty": [ { "hydra:property": "eventStatus", "hydra:required": "true", "readonlyValue": false }, { "hydra:property": "location", "defaultValue": "Wiesbaden", "readonlyValue": false }, ... other properties required for a replacing PUT ] } }, { "hydra:method": "DELETE" } ] }

=== Specifying Property Value Requirements (from V. 0.2.0)

Now let us tell the client a range of possible values for a property. We want to allow clients to add reviews for the work performed at an event. For this, we add a Resource<CreativeWork> to the Event, so that we can define an affordance on the creative work which allows clients to send reviews.

[source, Java]

public class Event { ... private final Resource workPerformed;

  public Resource<CreativeWork> getWorkPerformed() {
      return workPerformed;
  }
  ...

}

// in EventController: @RequestMapping(value = "/{eventId}", method = RequestMethod.GET) public @ResponseBody Resource getEvent(@PathVariable Integer eventId) {

  // with an event from backend do this:

  event.getWorkPerformed() //  <-- must be a Resource<CreativeWork>
      .add(linkTo(methodOn(ReviewController.class) // <-- must use AffordanceBuilder.linkTo here
          .addReview(event.id, new Review(null, new Rating(3)))) // <-- default ratingValue 3
          .withRel("review"));
  ...

}

@Controller @RequestMapping("/reviews") public class ReviewController {

  @RequestMapping(value = "/events/{eventId}", method = RequestMethod.POST)
  public ResponseEntity<Void> addReview(@PathVariable int eventId, @RequestBody Review review) {
      // add review and return 201 Created
  }

}

We expect that clients post a Review with a review body and a rating. The review body and the rating value have input constraints, so we annotate the method setReviewBody with @Input(pattern=".{10,}") and setRatingValue with @Input(min = 1, max = 5, step = 1), as shown below.

[source, Java]

public class Rating { private String ratingValue;

  @JsonCreator
  public Rating(@JsonProperty("ratingValue") Integer ratingValue) {
    ..
  }

  public void setRatingValue(@Input(min = 1, max = 5, step = 1) String ratingValue) {
      this.ratingValue = ratingValue;
  }

}

public class Review {

  private String reviewBody;
  private Rating reviewRating;

  @JsonCreator
  public Review(@JsonProperty("reviewBody") String reviewBody,
      @JsonProperty("reviewRating") Rating reviewRating) {
         ...
  }

  public void setReviewBody(@Input(pattern=".{10,}") String reviewBody) {
    ...
  }

  public void setReviewRating(Rating rating) {
      this.reviewRating = rating;
  }

}


In the resulting json-ld we use schema.org's http://schema.org/PropertyValueSpecification[PropertyValueSpecification] to express the input constraints minValue, maxValue, stepValue and valuePattern, as well as defaultValue containing the rating value 3 that was passed to the sample method invocation with methodOn. Note that the creative work has a review attribute now, although the CreativeWork pojo has no such property. It appears because we added a rel review to the workPerformed resource.

Right now it is not possible to specify a list of expected values, neither with hydra nor with schema:PropertyValueSpecification. If you are interested in that, look into https://github.com/HydraCG/Specifications/issues/82[#82 Add support for allowed literals and allowed individuals] and participate in the discussion in the http://lists.w3.org/Archives/Public/public-hydra/2015Jan/0019.html[Hydra-CG mailing list].

[source, Javascript]

{ "@context": { "@vocab": "http://schema.org/", "hydra": "http://www.w3.org/ns/hydra/core#", "eventStatus": { "@type": "@vocab" }, "EVENT_SCHEDULED": "EventScheduled" }, "@type": "Event", "performer": "Walk off the Earth", "location": "Wiesbaden", "eventStatus": "EVENT_SCHEDULED", "workPerformed": { "@type": "CreativeWork", "name": "Gang of Rhythm Tour", "review": { "@id": "http://localhost:8210/webapp/hypermedia-api/reviews/events/1", "hydra:operation": [ { "@type": "ReviewAction", "hydra:method": "POST", "hydra:expects": { "@type": "Review", "hydra:supportedProperty": [ { "@type": "PropertyValueSpecification", "hydra:property": "reviewBody", "valuePattern": ".{10,}" }, { "hydra:property": "reviewRating", "rangeIncludes": { "@type": "Rating", "hydra:supportedProperty": [ { "@type": "PropertyValueSpecification", "hydra:property": "ratingValue", "defaultValue": 3, "maxValue": 5, "minValue": 1, "stepValue": 1 } ] } } ] } } ] } } }


If an expected property on a request object holds a nested json object in turn, hydra-java will render it following a proposal from https://github.com/HydraCG/Specifications/issues/26[Hydra-CG Issue 26] using http://schema.org/rangeIncludes[schema:rangeIncludes]. The fact that this issue is not resolved yet is the main reason why hydra-java 0.2.0 is an alpha release. So be especially wary that changes are likely for the way hydra-java prescribes nested properties.

=== Rendering other media types (from V. 0.2.0-alpha8)

Clients should be able to request a media-type they understand by means of content negotiation. Following this principle, the spring-hateoas-ext package provides the foundation to render hypermedia types which describe expected requests - not only as json-ld, but also as other media types.

==== XhtmlResourceMessageConverter

The XhtmlResourceMessageConverter is the second message converter in hydra-java which makes use of affordances built by AffordanceBuilder.

If you add a JsonLdDocumentationProvider on the converter, it will render bean attributes as hyperlinks which point to their documentation on schema.org or other vocabularies, provided that your java beans are annotated with the necessary information.

The xhtml response renders bootstrap conforming markup, you can add bootstrap css as shown below, or your own stylesheets.

[source, Java]

@Configuration @EnableWebMvc public class Config extends WebMvcConfigurerAdapter { ... @Override public void configureMessageConverters(List<HttpMessageConverter<?>> converters) { converters.add(halConverter()); converters.add(xhtmlMessageConverter()); converters.add(jsonConverter()); }

private HttpMessageConverter<?> xhtmlMessageConverter() {
    XhtmlResourceMessageConverter xhtmlResourceMessageConverter = new XhtmlResourceMessageConverter();
    xhtmlResourceMessageConverter.setStylesheets(
            Arrays.asList(
                    "https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css"
            ));
    xhtmlResourceMessageConverter.setDocumentationProvider(new JsonLdDocumentationProvider());
    return xhtmlResourceMessageConverter;
}
...

}


To make the API browsable, PUT and DELETE are tunneled through POST. This is necessary because the HTML media type does not support PUT or DELETE, the browser cannot handle a form which has other methods than GET or POST. Spring-MVC has a servlet filter which makes tunneling easy. The web.xml of the hydra-sample service shows how to enable that filter:

[source, XML]

<filter>
    <filter-name>HiddenHttpMethodFilter</filter-name>
    <filter-class>org.springframework.web.filter.HiddenHttpMethodFilter</filter-class>
</filter>
<filter-mapping>
    <filter-name>HiddenHttpMethodFilter</filter-name>
    <servlet-name>hypermedia-api</servlet-name>
</filter-mapping>

==== SirenMessageConverter (from V. 0.2.0-beta5) The SirenMessageConverter renders Spring Hateoas Responses as https://github.com/kevinswiber/siren[Siren] messages, using the media type application/vnd.siren+json.

The Siren output for the sample EventController above is shown below. Note that the JsonLdDocumentationProvider has created the link relation type http://schema.org/workPerformed. One could also use the UrlPrefixDocumentationProvider for simple URL prefixing. [source, Javascript]

{ "class": [ "event" ], "properties": { "performer": "Walk off the Earth", "eventStatus": "EVENT_SCHEDULED", "location": "Wiesbaden" }, "entities": [ { "class": [ "creativeWork" ], "rel": [ "http://schema.org/workPerformed" ], "properties": { "name": "Gang of Rhythm Tour" }, "actions": [ { "name": "addReview", "method": "POST", "href": "http://example.com/webapp/hypermedia-api/reviews/events/1", "fields": [ { "name": "reviewBody", "type": "text" }, { "name": "reviewRating.ratingValue", "type": "number", "value": "3" } ] } ] } ], "actions": [ { "name": "updateEvent", "method": "PUT", "href": "http://example.com/webapp/hypermedia-api/events/1", "fields": [ { "name": "location", "type": "text", "value": "Wiesbaden" }, { "name": "eventStatus", "type": "radio", "value": [ { "value": "EVENT_CANCELLED" }, { "value": "EVENT_POSTPONED" }, { "value": "EVENT_SCHEDULED", "selected": true }, { "value": "EVENT_RESCHEDULED" } ] } ... other properties required for a replacing PUT ] }, { "name": "deleteEvent", "method": "DELETE", "href": "http://example.com/webapp/hypermedia-api/events/1" } ], "links": [ { "rel": [ "self" ], "href": "http://example.com/webapp/hypermedia-api/events/1" } ] }

== Maven Support The latest Maven releases of hydra-java are in Maven central. These are the maven coordinates for hydra-spring.

[source, XML]

de.escalon.hypermedia hydra-spring 0.4.1

If you only want to use AffordanceBuilder or the XhtmlResourceMessageConverter and SirenMessageConverter without the json-ld dependencies, use spring-hateoas-ext alone:

[source, XML]

de.escalon.hypermedia spring-hateoas-ext 0.4.1

== Vocabularies What if schema.org is not sufficient? On http://lov.okfn.org/dataset/lov/[Linked Open Vocabularies] you can search for terms in other vocabularies. Another option is to http://www.w3.org/wiki/WebSchemas/SchemaDotOrgProposals[propose an addition to schema.org].

If you are unsure which vocab to use, ask on the http://lists.w3.org/Archives/Public/public-hydra/[ hydra mailing list].

== What's new === 0.4.1

=== 0.4.0

=== 0.3.1

=== 0.3.0

== Acknowledgements

I would like to thank Mike Amundsen, Stu Charlton, Jon Moore, Jørn Wildt, Mike Kelly, Markus Lanthaler, Gregg Kellog and Manu Sporny for their inspiration and for valuable comments along the way. Also thanks to Oliver Gierke who has been accepting some of my pull requests to spring-hateoas.