public/html2wiki: src/org/nwoca/ssdt/tools/html2wiki/Html2Wiki.java annotate

annotate src/org/nwoca/ssdt/tools/html2wiki/Html2Wiki.java @ 11:8f23347884c0

Deal with double dashes surrounded by words. ReplaceTransformer can now replace specific group.

author	smith@nwoca.org
date	Fri, 28 Jan 2011 13:57:25 -0500
parents	2fb5084b1564
children	c1d94c623854

rev	line source
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	1 package org.nwoca.ssdt.tools.html2wiki;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	2 /*
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	3 * Html2Wiki.java
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	4 *
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	5 * Created on May 9, 2006, 3:22 PM
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	6 *
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	7 */
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	8
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	9 import java.io.*;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	10 import java.util.Collection;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	11 import java.util.ArrayList;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	12 import java.util.List;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	13 import org.apache.commons.io.FileUtils;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	14 import java.util.regex.*;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	15
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	16 /**
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	17 * Converter to convert HTML documents into MediaWiki test.
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	18 *
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	19 * Heavily customized to handle HTML produced by DEC DOCUMENT
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	20 * SOFTARE doctype. Breaks file into Chapters in the manner done
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	21 * by Document. Needs modification to work with other HTML files.
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	22 *
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	23 * @author SMITH
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	24 */
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	25 public class Html2Wiki {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	26
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	27 private StringBuffer buffer;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	28 private Collection<Transformer> transformers;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	29 private boolean converted = false;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	30 private static String category;
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	31
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	32 /** Creates a new instance of Html2Wiki. */
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	33 public Html2Wiki(String html) {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	34 buffer = new StringBuffer(html);
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	35 transformers = new ArrayList<Transformer>();
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	36 transformers.add(new DeleteTransformer("<html>\|</html>\|<body>\|</body>"));
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	37 transformers.add(new DeleteTransformer("<!--.-->(\\n\|\\r)",true));
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	38 transformers.add(new DeleteTransformer("<a .*?>\|</a>"));
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	39 transformers.add(new DeleteTransformer("(?m)^\\*"));
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	40 transformers.add(new DeleteTransformer("(?m)<br>$"));
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	41 transformers.add(new DeleteTransformer("<font .*?>\|</font>"));
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	42 transformers.add(new CloseTagTransformer("<li>","(\n\|\r)*(<li>\|</ul>\|</ol>\|<ul>\|<ol>)","</li>"));
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	43 transformers.add(new BadTableDataTransformer());
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	44 transformers.add(new BadTableRowTransformer());
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	45 transformers.add(new ReflowTransformer());
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	46 transformers.add(new DeleteTransformer("<p>"));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	47 transformers.add(new ReplaceTransformer("\\{","\\{")); // Escape braces
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	48 transformers.add(new ReplaceTransformer("\\}","\\}"));
7 a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	49
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	50 transformers.add(new ReplaceTransformer("\\[","\\[")); // Escape brackets
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	51 transformers.add(new ReplaceTransformer("\\]","\\]"));
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	52 transformers.add(new PreTagTransformer()); // Unescape brackets inside <pre>
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	53 //
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	54 transformers.add(new ReplaceTransformer("<br>","\\\\"));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	55
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	56 //replace table tag preserving border setting.
10 2fb5084b1564 [no commit message] ferrall@nwoca.org parents: 9 diff changeset	57 transformers.add(new TagTransformer("<table\\sborder=(\\d).*?>", true, "{table:border=", "\|width=75%}"));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	58
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	59 transformers.add(new ReplaceTransformer("<table.*?>\|</table>","{table}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	60 transformers.add(new ReplaceTransformer("<tr>\|</tr>","{tr}"));
5 d34f4d408ef9 [no commit message] ferrall@nwoca.org parents: 4 diff changeset	61 transformers.add(new ReplaceTransformer("<td.*?>\|</td>","{td}"));
d34f4d408ef9 [no commit message] ferrall@nwoca.org parents: 4 diff changeset	62 transformers.add(new ReplaceTransformer("<th.*?>\|</th>","{th}"));
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	63 transformers.add(new ReplaceTransformer("<ol.*?>\|</ol>","{ol}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	64 transformers.add(new ReplaceTransformer("<ul.*?>\|</ul>","{ul}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	65 transformers.add(new ReplaceTransformer("<li>","{li}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	66 transformers.add(new ReplaceTransformer("</li>","{li}\n"));
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	67
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	68 transformers.add(new ChapterTransformer(category));
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	69 transformers.add(new TagTransformer("<pre>(.*?)</pre>", true, "{code}","{code}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	70 transformers.add(new TagTransformer("<center>(.*?)</center>", true, "{center}","{center}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	71 transformers.add(new TagTransformer("<em>(.?)</em>", "","*"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	72 transformers.add(new TagTransformer("<strong>(.?)</strong>", "","*"));
9 ccb40d1cb213 [no commit message] ferrall@nwoca.org parents: 8 diff changeset	73 transformers.add(new TagTransformer("<u>(.*?)</u>" , "+","+"));
4 22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	74 transformers.add(new TagTransformer("(?s)<kbd>(.*?)</kbd>", "{{", "}}"));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	75 transformers.add(new TagTransformer("<h1>(.*)</h1>", "h1. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	76 transformers.add(new TagTransformer("<h2>(.*)</h2>", "h2. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	77 transformers.add(new TagTransformer("<h3>(accessing the program\|sample run\|sample screens?\|sample reports?)</[h\|H]3>","h3.", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	78 transformers.add(new TagTransformer("<h3>(.*)</H3>", "h3. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	79 transformers.add(new TagTransformer("<h3>(.*)</h3>", "h3. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	80 transformers.add(new TagTransformer("<h4>(.*)</h4>", "h4. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	81 transformers.add(new TagTransformer("<h5>(.*)</h5>", "h5. ", ""));
22ed6d93442c Start modifying transformers to Confluence wiki syntax smith@nwoca.org parents: 2 diff changeset	82 transformers.add(new TagTransformer("<h6>(.*)</h6>", "h6. ", ""));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	83
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	84 //Replace Notes with Info tags.
10 2fb5084b1564 [no commit message] ferrall@nwoca.org parents: 9 diff changeset	85 transformers.add(new ReplaceTransformer("\\{center}\\n\\{table:border=\\d.}\\n\\{tr\\}\\n\\s{2}\\{td\\}\\{center\\}\\Note\\*\\{center\\}","{info}"));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	86 transformers.add(new ReplaceTransformer("\\{td\\}\\n\\s{2}\\{tr\\}\\n\\{table\\}\\n\\{center\\}","{info}"));
5 d34f4d408ef9 [no commit message] ferrall@nwoca.org parents: 4 diff changeset	87
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	88 //Remove unnecessary table surrounding code blocks.
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	89 transformers.add(new ReplaceTransformer("\\{table:.*\\}\\n\\s{2}\\{tr\\}\\n\\s{4}\\{td\\}\\n\\s{6}\\n\\{code\\}","{code}"));
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	90 transformers.add(new ReplaceTransformer("\\{code\\}\\n\\{td\\}\\{tr\\}\\{table\\}","{code}"));
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	91
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	92 //Change borderStyle of code window for "screenshots" to none.
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	93 transformers.add(new TagTransformer("\\{code\\}([\\s\\n]*?_______________)", true, "{code:borderStyle=none}", ""));
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	94
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	95
e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	96
7 a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	97 transformers.add(new TagTransformer("<blockquote>(.*?)</blockquote>", true, "{quote}", "{quote}"));
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	98 transformers.add(new DeleteTransformer("(?s)<hr.*?>"));
8 e8ea26ab2cd7 [no commit message] ferrall@nwoca.org parents: 7 diff changeset	99 transformers.add(new ReflowTransformer("(\\{info\\})([^\\{]*)(\\{info\\})"));
7 a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	100 transformers.add(new TagTransformer("<sup>(.*?)</sup>", true, "^\\[","\\]^ "));
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	101 transformers.add(new ReplaceTransformer("<","<"));
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	102 transformers.add(new ReplaceTransformer(">",">"));
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	103 transformers.add(new ReplaceTransformer(""","\""));
a634b4d554d4 Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag. smith@nwoca.org parents: 6 diff changeset	104 transformers.add(new ReplaceTransformer(":\\)",": )")); // No smilies...
11 8f23347884c0 Deal with double dashes surrounded by words. ReplaceTransformer can now replace specific group. smith@nwoca.org parents: 10 diff changeset	105 transformers.add(new ReplaceTransformer("(\\w)(--)(\\w)"," -- ",2));
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	106
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	107 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	108
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	109 /**
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	110 * @param args the command line arguments
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	111 */
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	112 public static void main(String[] args) throws IOException {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	113
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	114 if (args.length == 0) {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	115 System.out.println("Usage:");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	116 System.out.println(" Html2Wiki {inputDirectory} [Category]");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	117 System.out.println(" default is current directory");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	118 System.out.println(" Processes all *.html files. ");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	119 System.out.println(" Each 'chapter' written to *.wiki");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	120 return;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	121 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	122
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	123 File inputs = new File(args[0]);
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	124
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	125 if (args.length > 1) {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	126 category = args[1];
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	127 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	128
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	129 File[] inputFiles = inputs.listFiles(new HtmlFileFilter());
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	130 for (int i = 0; i < inputFiles.length; i++) {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	131
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	132 process(inputFiles[i]);
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	133
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	134 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	135
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	136 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	137
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	138 protected static void process(File input) throws IOException {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	139
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	140 System.out.println(input.getAbsoluteFile());
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	141
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	142 Html2Wiki converter = new Html2Wiki(FileUtils.readFileToString(input, null));
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	143
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	144 WikiChapter[] chapters = converter.getWikiChapters();
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	145
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	146 System.out.format("Writing %d wiki files...\n", chapters.length);
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	147
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	148
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	149 for (int i = 0; i < chapters.length; i++) {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	150
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	151 FileUtils.writeStringToFile(new File(input.getParent(),
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	152 generateFilename(chapters[i].getChapterName()) + ".wiki"),
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	153 chapters[i].getContents().toString(),
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	154 null);
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	155
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	156 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	157
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	158 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	159
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	160 public static String generateFilename(String input) {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	161 return input.replaceAll("\\\\\|/\|:\|\$\|\$", "-").replace("<br>", "");
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	162
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	163 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	164
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	165 public String getWikiText() {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	166 convert();
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	167 return buffer.toString();
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	168 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	169
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	170 public WikiChapter[] getWikiChapters() {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	171
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	172 convert();
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	173
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	174 List<WikiChapter> chapters = new ArrayList<WikiChapter>();
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	175
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	176 Pattern chapterPat = Pattern.compile("<chapter>");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	177 Matcher begin = chapterPat.matcher(buffer);
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	178 Matcher end = chapterPat.matcher(buffer);
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	179
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	180 while (begin.find()) {
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	181
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	182
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	183 end.find(begin.end());
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	184
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	185 Pattern chapterNamePat = Pattern.compile("<chapter>(.*?)</chapter>");
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	186
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	187 Matcher chapterNameMatcher = chapterNamePat.matcher(buffer);
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	188
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	189 String chapterName = chapterNameMatcher.find(begin.start()) ? chapterNameMatcher.group(1) : null;
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	190
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	191 CharSequence contents = buffer.subSequence(chapterName == null ? begin.start() : chapterNameMatcher.end(), end.hitEnd() ? buffer.length() : end.start());
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	192
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	193 chapters.add(new WikiChapter(chapterName, contents));
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	194
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	195 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	196 return (WikiChapter[]) chapters.toArray(new WikiChapter[]{});
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	197 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	198
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	199 private void convert() {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	200
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	201 if (!converted) {
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	202 for (Transformer t : transformers) {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	203
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	204 System.out.println(".Applying: " + t);
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	205 t.apply(buffer);
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	206
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	207 }
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	208 }
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	209 converted = true;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	210 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	211
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	212 private static class HtmlFileFilter implements FileFilter {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	213
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	214 public boolean accept(File pathname) {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	215 return pathname.getName().toLowerCase().matches("^.*\\.html$");
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	216 }
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	217 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	218
2 5da2e67620f9 Upgrade to Ivy configuration and begin clean up of tests. Added FreeBSD license. smith@nwoca.org parents: 0 diff changeset	219 protected static class WikiChapter {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	220
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	221 private String chapterName;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	222 private CharSequence contents;
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	223
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	224 public WikiChapter(String chapterName, CharSequence contents) {
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	225 this.chapterName = chapterName.replaceAll("\\\\\|/\|:\|\$\|\$", "-").replaceAll("\\s+", " ").replaceAll("&", "and");
99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	226
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	227 this.contents = contents;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	228 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	229
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	230 public String getChapterName() {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	231 return chapterName;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	232 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	233
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	234 public CharSequence getContents() {
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	235 return contents;
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	236 }
6 99f293bd507f Add "reflow" transformer to reflow paragraphs, list items, etc. smith@nwoca.org parents: 5 diff changeset	237
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	238 public String toString() {
2 5da2e67620f9 Upgrade to Ivy configuration and begin clean up of tests. Added FreeBSD license. smith@nwoca.org parents: 0 diff changeset	239 return "Chapter: " + chapterName + " Content length: " + contents.length();
0 f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	240 }
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	241 }
f8b1ea49d065 Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup. smith@nwoca.org parents: diff changeset	242 }

Mercurial > public > html2wiki

annotate src/org/nwoca/ssdt/tools/html2wiki/Html2Wiki.java @ 11:8f23347884c0