Many E-commerce platforms allow users to write their opinions towards products, and these reviews contain rich semantic information for users and items. Hence review analysis has been widely used in recommendation systems. However, most existing review-based recommendation methods focus on a single view of reviews and ignore the diversity of users and items since users always have multiple preferences and items always have various characteristics. In this paper, we propose a neural recommendation method with hierarchical multi-view attention which can effectively learn diverse user preferences and multiple item features from reviews. We design a review encoder with multi-view attention to learn representations of reviews from words, which can extract multiple points of a review. In addition, to learn representations of users and items from their reviews, we design a user/item encoder based on another multi-view attention. In this way, the diversity of user preference and item features can be fully exploited. Compared with the existing single attention approaches, the hierarchical multi-view attention in our method has the potential for better user and product modeling from reviews. We conduct extensive experiments on four recommendation datasets, and the results validate the advantage of our method for review based recommendation.