Gujarati text in Java String

Question

I have Gujarati Bible and trying to insert each verse in MySQL database using parser written in Java. When I assign Gujarati text to Java String variable it shows junks in debug.

E.g. This is my Gujarati text

હે યહોવા તું મારો દેવ છે;

I assign it to Java String variable as shown below

verse._verseText = "હે યહોવા તું મારો દેવ છે;";

What i see in debug window is all junk characters. Any help is appreciated. If need more information let me know and I will provide as and when asked.

UPDATE Pasting my parser code here

private Boolean Insert(String _text)
{
    BibleVerse verse = new BibleVerse();
    String[] data = _text.split("\\|");
    try
    {
        if (data[0].equals(bookName) || bookName.equals("All"))
        {
            verse._Version = "Gujarati";
            verse._book = data[0];
            verse._chapter = Integer.parseInt(data[1]); 
            verse._verse = Integer.parseInt(data[2]);
            verse._verseText = new String(data[3].getBytes(), "UTF-8");
            _bibleDatabase.Insert(verse);
            pcs.firePropertyChange("logupdate", null, data[0] + " " + data[1] + "," + data[2] + " - INSERTED.");
        }
        else
        {
            pcs.firePropertyChange("logupdate", null, data[0] + " " + data[1] + "," + data[2] + " - SKIPPED.");
        }
        return true;
    }
    catch(Exception e)
    {
        pcs.firePropertyChange("logupdate", null, "ERROR : " + e.getMessage());
        return false;
    }       
}

Here is the sample line from the text file

Isaiah|25|1|હે યહોવા તું મારો દેવ છે; હું તને મોટો માનીશ, હું તારા નામની સ્તુતિ કરીશ; કેમકે તેં અદભુત કાર્યો કર્યાં છે, તેં વિશ્વાસુપણે તથા સત્યતાથી પુરાતન સંકલ્પો પાર પાડ્યા છે.

UPDATE Here is the code where I open & read file.

try 
    {
        FileReader _file = new FileReader(this._filename);  
        _bufferedReader = new BufferedReader(_file);

        SwingWorker parseWorker = new SwingWorker()
        {
            @Override
            protected Object doInBackground() throws Exception 
            {
                String line;
                String[] data;
                int lineno=0;
                BibleVerse verse = new BibleVerse();

                while ((line = _bufferedReader.readLine()) != null) 
                {
                    ++lineno;
                    pcs.firePropertyChange("pgbupdate", null, lineno);
                    Insert(line);
                }
                _bufferedReader.close();
                return null;
            }

            @Override
            protected void done()
            {
                pcs.firePropertyChange("logupdate", null, "Parsing complete.");
            }
        };
        parseWorker.execute();
    } 
    catch (Exception e) 
    {
        pcs.firePropertyChange("logupdate", null, "ERROR : " + e.getMessage());
    }

Answer 1

how to inject chinese characters using javascript?

not quite the same problem, but I think the same solution may work in this case.

If the script is inline (in the HTML file), then it's using the encoding of the HTML file and you won't have an issue.

If the script is loaded from another file:

Your text editor must save the file in an appropriate encoding such as utf-8 (it's probably doing this already if you're able to save it, close it, and reopen it with the characters still displaying correctly) Your web server must serve the file with the right http header specifying that it's utf-8 (or whatever the enocding happens to be, as determined by your text editor settings). Here's an example for how to do this with php: Set http header to utf-8 php If you can't have your webserver do this, try to set the charset attribute on your script tag (e.g. > I tried to see what the spec said should happen in the case of mismatching charsets defined by the tag and the http headers, but couldn't find anything concrete, so just test and see if it helps. If that doesn't work, place your script inline

Answer 2

The problem is this:

FileReader _file = new FileReader(this._filename);

This reads the file using the platform's default charset. If your data file is not encoded in that charset, you will get incorrect characters.

On Windows, the default charset is almost always UTF-16LE. On most other systems, it's UTF-8.

The easiest solution is to find out the actual encoding of your data file, so you can specify it explicitly in the code. The encoding of a file can be determined with the file command on Unix and Linux systems. In Windows, you may need to examine it with a binary editor, or install something like Cygwin, which has a file command of its own.

Once you know what it is, you should pass it explicitly to the construction of your Reader:

// Replace "UTF-8" with the actual encoding of your data file (if it's not UTF-8).
Reader _file = new InputStreamReader(new FileInputStream(this._filename), "UTF-8");

Once you've done that, there is no reason for any other part of your code to concern itself with bytes. You should replace this:

verse._verseText = new String(data[3].getBytes(), "UTF-8");

with this:

verse._verseText = data[3];

Answer 3

It looks like if you want to store Gujarati text in Java string, you need to use unicode characters. See this: http://jrgraphix.net/r/Unicode/0A80-0AFF

So for example the first Gujarati character:

char example = '0A80';
String result = Character.toString((char)example);