The Yoruba Dictionary web application powers the backend services for www.yorubaword.com. It includes various modules that implement the various needed functionality. The code for the front-facing website found at www.yorubaword.com is also included in it.
This should be your 5-minute guide to getting the application running on your local machine and contributing code.
You need to have the following installed:
- JDK 1.6+
- MySQL (you do not need to install MySQL if running in in-memory mode. Continue reading to learn how to start the application with in memory database)
- Maven
Consult this link for more information on how to install the JDK.
Consult this link for more information on how to install Maven.
First a quick overview of how things stack up should be of help.
The Yoruba Dictionary web application is the backend portion of the Yoruba dictionary, and it is built around individual modules that perform one functionality and that functionality only. For example we have elastic-search module for the search etc.
The webapi-module is built using these other modules and its own functionality is to expose the services the dictionary
application offers over a REST API.
The website module is the front facing part of the dictionary. It is also built using the APIs exposed by the webapi-module
The idea behind this set up is to be able to deploy the webapi-module and build services on its API the way
the Yoruba Dictionary dashboard dashboard app does.
A mobile tier would also take advantage of this setup or to have the webapi-module as a coupled
dependency to another software component (The way the website component depends on webapi-module.)
Now with the general overview out of the way, let us look at getting the application running on your local machine.
There are two ways in which the application can be run for development:
- With a MySQL datastore
- With In-memory Database
Running the application with a MySQL database requires MySQL to be installed and running on the machine the application would be running on. The necessary database also needs to have been created.
Running the application with an in-memory database does not require the installation and running of a database.
The next two sections describe how to start the application in the two outlined ways.
Feel free to skip this section and go to Running the Website Application In in-memory mode below if you do not intend to install/use MySQL.
Note, since the Yoruba Language makes extensive use of diacritics, your MySQL install needs to be configured to use UTF-8 in other to be able to handle the contents of the dictionary. If this is not done, the application won't start, because the bootstrap process inserts words which use diacritics into the database, and if the encoding is not right, the inserting would fail. In such a case you would see an error similar to:
Caused by: java.sql.SQLException: Incorrect string value: '\xE1\xBB\x8D\xCD\x81l...' for column 'extended_meaning' at row 1
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:996)
Basically you would want to find your my.conf file and add the following piece of configuration:
[mysqld]
character-set-server=utf8
collation-server=utf8_general_c
You can consult the [Configuring the Character Set and Collation for Applications](https://dev.mysql .com/doc/refman/en/charset-applications.html) section from the MySQL documentation for more details.
First create a MySQL database, with the following details:
- Database Name: yoruba_dictionary
- Username: dictionary
- Password: dictionary
In case you went ahead to install MySQL and created your database, without setting the character set as mentioned above, you can still alter your database to make use of the correct character set. To do that, run the following MySQL command:
ALTER DATABASE 'dictionary' DEFAULT CHARACTER SET = 'utf8' COLLATE 'utf8_unicode_ci';
Once the MySQL database has been created, and the encoding is set up all fine, you then have a couple of ways to start the core application.
If you use an IDE like Intellij, you can run the application by running the public static void main
in DictionaryApplication class; you just need to make sure in the VM options, you pass
-Dspring.profiles.active=development as the value
- cd into the projects parent directory and run
mvn clean install. This would download all the project's dependencies, build the project and install it locally into the maven repository - cd into the website module ({parent_directory}/website) and run
mvn spring-boot:run -Dspring.profiles.active=development
The application would start up and can be accessed on port 8081.
Remember this command needs to be run from the website module, that is {parent_directory}/website directory.
It is also possible to run the application with the datastore being in-memory. In that case, there won't be a need to install MySQL and the application can function without any external dependencies.
The disadvantage is that whatever you add to the dictionary won't be durably persisted and would be lost on restart.
You can also start the application via an IDE when running with an in-memory database. If you use an IDE like
Intellij, you can run the application by creating a Run configuration that runs the public static void main in
DictionaryApplication class; you just need to make sure in the VM options, you pass -Dspring.profiles .active=inmemory as the value
To start the application in in-memory mode via the Spring boot run plugin, specify inmemory as the active profile
when starting the application. For example:
mvn spring-boot:run -Dspring.profiles.active=inmemory
Remember this command needs to be run from the website module, that is {parent_directory}/website directory.
The search API is defined in the searchapi module. We currently have two implementations for the search api:
- ElasticSearch - Implemented in the
elasticsearch-modulemodule - JPA based search - Implemented in the
jpa-search-modulemodule
The jpa-search-module module is used in the website module which represents the website running at www.yorubaword.com
If you want to use elasticsearch module then remove the following section in the pom.xml for website module:
<dependency>
<groupId>${project.groupId}</groupId>
<artifactId>jpa-search-module</artifactId>
<version>${project.version}</version>
</dependency>
with
<dependency>
<groupId>${project.groupId}</groupId>
<artifactId>elasticsearch-module</artifactId>
<version>${project.version}</version>
</dependency>
The elasticsearch-module needs to be configured. This is explained in the next session.
The ElasticSearch module does not require the installation of ElasticSearch as it will run with an embedded ElasticSearch instance: the only thing required is for the appropriate configurations to be provided which can be done in the application properties.
Different aspect of the embedded ElasticSearch be configured via application properties. The available configuration keys and their defaults are
- es.clustername=yoruba_dictionary
- es.indexname=dictionary
- es.documenttype=wordentry
- es.hostname=localhost
- es.portnumber=9300
- es.data.path=
The embedded ElasticSearch module will by default create a "data" directory in the root directory where the application
runs from and use this as the location to store data. This directory location can be configured to somewhere else
by supplying the preferred directory through the es.data.path in the application.properties
The documentation for the API endpoints can be accessed by running the application and navigating to http://localhost:8081/swagger-ui.html
The Yoruba Dictionary dashboard application powers the admin portal that can be used by authorized personnel to manage entries in the Yoruba dictionary. It is a standalone application with a separate codebase.
The instructions on how to run the Yoruba Dictionary dashboard application can be found here https://github.com/Yorubaname/the-yoruba-dictionary-dashboard