Skip to content

DATAREDIS-423 - Add support for Jackson2 based HashMapper. #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

<groupId>org.springframework.data</groupId>
<artifactId>spring-data-redis</artifactId>
<version>1.8.0.BUILD-SNAPSHOT</version>
<version>1.8.0.DATAREDIS-423-SNAPSHOT</version>

<name>Spring Data Redis</name>

Expand Down
66 changes: 64 additions & 2 deletions src/main/asciidoc/reference/redis.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -363,8 +363,9 @@ Hash mappers are converters to map objects to a `Map<K, V>` and back. `HashMappe

Multiple implementations are available out of the box:

1. `BeanUtilsHashMapper` using Spring's http://docs.spring.io/spring/docs/current/javadoc-api/org/springframework/beans/BeanUtils.html[BeanUtils]
2. `ObjectHashMapper` using <<redis.repositories.mapping>>
1. `BeanUtilsHashMapper` using Spring's http://docs.spring.io/spring/docs/current/javadoc-api/org/springframework/beans/BeanUtils.html[BeanUtils].
2. `ObjectHashMapper` using <<redis.repositories.mapping>>.
3. <<redis.hashmappers.jackson2,`Jackson2HashMapper`>> using https://github.com/FasterXML/jackson[FasterXML Jackson].

[source,java]
----
Expand Down Expand Up @@ -396,6 +397,67 @@ public class HashMapping {
}
----

[[redis.hashmappers.jackson2]]
=== Jackson2HashMapper

`Jackson2HashMapper` provides Redis Hash mapping for domain objects using https://github.com/FasterXML/jackson[FasterXML Jackson].
`Jackson2HashMapper` can map data map top-level properties as Hash field names and optionally flatten the structure.
Simple types map to simple values. Complex types (nested objects, collections, maps) are represented as nested JSON.

Flattening creates individual hash entries for all nested properties and resolves complex types into simple types, as far as possible.

[source,java]
----
public class Person {
String firstname;
String lastname;
Address address;
}

public class Address {
String city;
String country;
}
----

.Normal Mapping
[width="80%",cols="<1,<2",options="header"]
|====
|Hash Field
|Value

|firstname
|`Jon`

|lastname
|`Snow`

|address
|`{ "city" : "Castle Black", "country" : "The North" }`
|====

.Flat Mapping
[width="80%",cols="<1,<2",options="header"]
|====
|Hash Field
|Value

|firstname
|`Jon`

|lastname
|`Snow`

|address.city
|`Castle Black`

|address.country
|`The North`
|====

NOTE: Flattening requires all property names to not interfere with the JSON path. Using dots or brackets in map keys
or as property names is not supported using flattening. The resulting hash cannot be mapped back into an Object.


:leveloffset: 2
include::{referenceDir}/redis-messaging.adoc[]
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,301 @@
/*
* Copyright 2016 the original author or authors.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
package org.springframework.data.redis.hash;

import java.io.IOException;
import java.util.ArrayList;
import java.util.HashMap;
import java.util.Iterator;
import java.util.LinkedHashMap;
import java.util.LinkedHashSet;
import java.util.List;
import java.util.Map;
import java.util.Map.Entry;
import java.util.Set;

import org.springframework.data.mapping.model.MappingException;
import org.springframework.data.util.DirectFieldAccessFallbackBeanWrapper;
import org.springframework.util.Assert;
import org.springframework.util.StringUtils;

import com.fasterxml.jackson.annotation.JsonInclude.Include;
import com.fasterxml.jackson.annotation.JsonTypeInfo.As;
import com.fasterxml.jackson.core.JsonParseException;
import com.fasterxml.jackson.databind.DeserializationFeature;
import com.fasterxml.jackson.databind.JsonMappingException;
import com.fasterxml.jackson.databind.JsonNode;
import com.fasterxml.jackson.databind.ObjectMapper;
import com.fasterxml.jackson.databind.ObjectMapper.DefaultTyping;
import com.fasterxml.jackson.databind.SerializationFeature;

/**
* {@link ObjectMapper} based {@link HashMapper} implementation that allows flattening. Given an entity {@code Person}
* with an {@code Address} like below the flattening will create individual hash entries for all nested properties and
* resolve complex types into simple types, as far as possible.
* <p>
* Flattening requires all property names to not interfere with JSON paths. Using dots or brackets in map keys or as
* property names is not supported using flattening. The resulting hash cannot be mapped back into an Object.
*
* <strong>Example</strong>
* <pre>
* <code>
* class Person {
* String firstname;
* String lastname;
* Address address;
* }
*
* class Address {
* String city;
* String country;
* }
* </code>
* </pre>
*
* <strong>Normal</strong>
* <table>
* <tr><th>Hash field</th><th>Value<th></tr>
* <tr><td>firstname</td><td>Jon<td></tr>
* <tr><td>lastname</td><td>Snow<td></tr>
* <tr><td>address</td><td>{ "city" : "Castle Black", "country" : "The North" }<td></tr>
* </table>
* <br />
* <strong>Flat</strong>:
* <table>
* <tr><th>Hash field</th><th>Value<th></tr>
*   <tr><td>firstname</td><td>Jon<td></tr>
* <tr><td>lastname</td><td>Snow<td></tr>
* <tr><td>address.city</td><td>Castle Black<td></tr>
* <tr><td>address.country</td><td>The North<td></tr>
* </table>
*
* @author Christoph Strobl
* @author Mark Paluch
* @since 1.8
*/
public class Jackson2HashMapper implements HashMapper<Object, String, Object> {

private final ObjectMapper typingMapper;
private final ObjectMapper untypedMapper;
private final boolean flatten;

/**
* Creates new {@link Jackson2HashMapper} with default {@link ObjectMapper}.
*
* @param flatten
*/
public Jackson2HashMapper(boolean flatten) {

this(new ObjectMapper(), flatten);

typingMapper.enableDefaultTyping(DefaultTyping.NON_FINAL, As.PROPERTY);
typingMapper.configure(SerializationFeature.WRITE_NULL_MAP_VALUES, false);
typingMapper.setSerializationInclusion(Include.NON_NULL);
typingMapper.configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES, false);
}

/**
* Creates new {@link Jackson2HashMapper}.
*
* @param mapper must not be {@literal null}.
* @param flatten
*/
public Jackson2HashMapper(ObjectMapper mapper, boolean flatten) {

Assert.notNull(mapper, "Mapper must not be null!");

this.typingMapper = mapper;
this.flatten = flatten;

this.untypedMapper = new ObjectMapper();
this.untypedMapper.configure(SerializationFeature.WRITE_NULL_MAP_VALUES, false);
this.untypedMapper.setSerializationInclusion(Include.NON_NULL);
}

/*
* (non-Javadoc)
* @see org.springframework.data.redis.hash.HashMapper#toHash(java.lang.Object)
*/
@Override
@SuppressWarnings("unchecked")
public Map<String, Object> toHash(Object source) {

JsonNode tree = typingMapper.valueToTree(source);
return flatten ? flattenMap(tree.fields()) : untypedMapper.convertValue(tree, Map.class);
}

/*
* (non-Javadoc)
* @see org.springframework.data.redis.hash.HashMapper#fromHash(java.util.Map)
*/
@Override
public Object fromHash(Map<String, Object> hash) {

try {

if (flatten) {

return typingMapper.reader().forType(Object.class)
.readValue(untypedMapper.writeValueAsBytes(doUnflatten(hash)));
}

return typingMapper.treeToValue(untypedMapper.valueToTree(hash), Object.class);

} catch (JsonParseException e) {
throw new MappingException(e.getMessage(), e);
} catch (JsonMappingException e) {
throw new MappingException(e.getMessage(), e);
} catch (IOException e) {
throw new MappingException(e.getMessage(), e);
}
}

@SuppressWarnings("unchecked")
private Map<String, Object> doUnflatten(Map<String, Object> source) {

Map<String, Object> result = new LinkedHashMap<String, Object>();
Set<String> treatSeperate = new LinkedHashSet<String>();
for (Entry<String, Object> entry : source.entrySet()) {

String key = entry.getKey();
String[] args = key.split("\\.");

if (args.length == 1 && !args[0].contains("[")) {
result.put(entry.getKey(), entry.getValue());
continue;
}

if (args.length == 1 && args[0].contains("[")) {

String prunedKey = args[0].substring(0, args[0].indexOf('['));
if (result.containsKey(prunedKey)) {
appendValueToTypedList(args[0], entry.getValue(), (List<Object>) result.get(prunedKey));
} else {
result.put(prunedKey, createTypedListWithValue(entry.getValue()));
}
} else {
treatSeperate.add(key.substring(0, key.indexOf('.')));
}
}

for (String partial : treatSeperate) {

Map<String, Object> newSource = new LinkedHashMap<String, Object>();

for (Entry<String, Object> entry : source.entrySet()) {
if (entry.getKey().startsWith(partial)) {
newSource.put(entry.getKey().substring(partial.length() + 1), entry.getValue());
}
}

if (partial.endsWith("]")) {

String prunedKey = partial.substring(0, partial.indexOf('['));

if (result.containsKey(prunedKey)) {
appendValueToTypedList(partial, doUnflatten(newSource), (List<Object>) result.get(prunedKey));
} else {
result.put(prunedKey, createTypedListWithValue(doUnflatten(newSource)));
}
} else {
result.put(partial, doUnflatten(newSource));
}
}

return result;
}

private Map<String, Object> flattenMap(Iterator<Entry<String, JsonNode>> source) {

Map<String, Object> resultMap = new HashMap<String, Object>();
this.doFlatten("", source, resultMap);
return resultMap;
}

private void doFlatten(String propertyPrefix, Iterator<Entry<String, JsonNode>> inputMap,
Map<String, Object> resultMap) {

if (StringUtils.hasText(propertyPrefix)) {
propertyPrefix = propertyPrefix + ".";
}

while (inputMap.hasNext()) {

Entry<String, JsonNode> entry = inputMap.next();
flattenElement(propertyPrefix + entry.getKey(), entry.getValue(), resultMap);
}
}

private void flattenElement(String propertyPrefix, Object source, Map<String, Object> resultMap) {

if (!(source instanceof JsonNode)) {

resultMap.put(propertyPrefix, source);
return;
}

JsonNode element = (JsonNode) source;
if (element.isArray()) {

Iterator<JsonNode> nodes = element.elements();

while (nodes.hasNext()) {

JsonNode cur = nodes.next();
if (cur.isArray()) {
this.falttenCollection(propertyPrefix, cur.elements(), resultMap);
}
}

} else if (element.isContainerNode()) {
this.doFlatten(propertyPrefix, element.fields(), resultMap);
} else {
resultMap.put(propertyPrefix, new DirectFieldAccessFallbackBeanWrapper(element).getPropertyValue("_value"));
}
}

private void falttenCollection(String propertyPrefix, Iterator<JsonNode> list, Map<String, Object> resultMap) {

int counter = 0;
while (list.hasNext()) {
JsonNode element = list.next();
flattenElement(propertyPrefix + "[" + counter + "]", element, resultMap);
counter++;
}
}

@SuppressWarnings("unchecked")
private void appendValueToTypedList(String key, Object value, List<Object> destination) {

int index = Integer.valueOf(key.substring(key.indexOf('[') + 1, key.length() - 1)).intValue();
List<Object> resultList = ((List<Object>) destination.get(1));
if (resultList.size() < index) {
resultList.add(value);
} else {
resultList.add(index, value);
}
}

private List<Object> createTypedListWithValue(Object value) {

List<Object> listWithTypeHint = new ArrayList<Object>();
listWithTypeHint.add(ArrayList.class.getName()); // why jackson? why?
List<Object> values = new ArrayList<Object>();
values.add(value);
listWithTypeHint.add(values);
return listWithTypeHint;
}
}
Loading