Mercurial > public > html2wiki
annotate src/org/nwoca/ssdt/tools/html2wiki/Html2Wiki.java @ 12:c1d94c623854
(none)
author | ferrall@nwoca.org |
---|---|
date | Fri, 28 Jan 2011 14:12:34 -0500 |
parents | 8f23347884c0 |
children | cf58f4b9902b |
rev | line source |
---|---|
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
1 package org.nwoca.ssdt.tools.html2wiki; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
2 /* |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
3 * Html2Wiki.java |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
4 * |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
5 * Created on May 9, 2006, 3:22 PM |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
6 * |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
7 */ |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
8 |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
9 import java.io.*; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
10 import java.util.Collection; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
11 import java.util.ArrayList; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
12 import java.util.List; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
13 import org.apache.commons.io.FileUtils; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
14 import java.util.regex.*; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
15 |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
16 /** |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
17 * Converter to convert HTML documents into MediaWiki test. |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
18 * |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
19 * Heavily customized to handle HTML produced by DEC DOCUMENT |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
20 * SOFTARE doctype. Breaks file into Chapters in the manner done |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
21 * by Document. Needs modification to work with other HTML files. |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
22 * |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
23 * @author SMITH |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
24 */ |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
25 public class Html2Wiki { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
26 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
27 private StringBuffer buffer; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
28 private Collection<Transformer> transformers; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
29 private boolean converted = false; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
30 private static String category; |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
31 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
32 /** Creates a new instance of Html2Wiki. */ |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
33 public Html2Wiki(String html) { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
34 buffer = new StringBuffer(html); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
35 transformers = new ArrayList<Transformer>(); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
36 transformers.add(new DeleteTransformer("<html>|</html>|<body>|</body>")); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
37 transformers.add(new DeleteTransformer("<!--.*-->(\\n|\\r)*",true)); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
38 transformers.add(new DeleteTransformer("<a .*?>|</a>")); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
39 transformers.add(new DeleteTransformer("(?m)^\\*")); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
40 transformers.add(new DeleteTransformer("(?m)<br>$")); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
41 transformers.add(new DeleteTransformer("<font .*?>|</font>")); |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
42 transformers.add(new CloseTagTransformer("<li>","(\n|\r)*(<li>|</ul>|</ol>|<ul>|<ol>)","</li>")); |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
43 transformers.add(new BadTableDataTransformer()); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
44 transformers.add(new BadTableRowTransformer()); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
45 transformers.add(new ReflowTransformer()); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
46 transformers.add(new DeleteTransformer("<p>")); |
8 | 47 transformers.add(new ReplaceTransformer("\\{","\\{")); // Escape braces |
48 transformers.add(new ReplaceTransformer("\\}","\\}")); | |
7
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
49 |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
50 transformers.add(new ReplaceTransformer("\\[","\\[")); // Escape brackets |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
51 transformers.add(new ReplaceTransformer("\\]","\\]")); |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
52 transformers.add(new PreTagTransformer()); // Unescape brackets inside <pre> |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
53 // |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
54 transformers.add(new ReplaceTransformer("<br>","\\\\")); |
8 | 55 |
56 //replace table tag preserving border setting. | |
10 | 57 transformers.add(new TagTransformer("<table\\sborder=(\\d).*?>", true, "{table:border=", "|width=75%}")); |
8 | 58 |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
59 transformers.add(new ReplaceTransformer("<table.*?>|</table>","{table}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
60 transformers.add(new ReplaceTransformer("<tr>|</tr>","{tr}")); |
5 | 61 transformers.add(new ReplaceTransformer("<td.*?>|</td>","{td}")); |
62 transformers.add(new ReplaceTransformer("<th.*?>|</th>","{th}")); | |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
63 transformers.add(new ReplaceTransformer("<ol.*?>|</ol>","{ol}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
64 transformers.add(new ReplaceTransformer("<ul.*?>|</ul>","{ul}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
65 transformers.add(new ReplaceTransformer("<li>","{li}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
66 transformers.add(new ReplaceTransformer("</li>","{li}\n")); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
67 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
68 transformers.add(new ChapterTransformer(category)); |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
69 transformers.add(new TagTransformer("<pre>(.*?)</pre>", true, "{code}","{code}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
70 transformers.add(new TagTransformer("<center>(.*?)</center>", true, "{center}","{center}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
71 transformers.add(new TagTransformer("<em>(.*?)</em>", "*","*")); |
12 | 72 transformers.add(new TagTransformer("<strong>(.*?)</strong>", true, "*","*")); |
9 | 73 transformers.add(new TagTransformer("<u>(.*?)</u>" , "+","+")); |
4
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
74 transformers.add(new TagTransformer("(?s)<kbd>(.*?)</kbd>", "{{", "}}")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
75 transformers.add(new TagTransformer("<h1>(.*)</h1>", "h1. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
76 transformers.add(new TagTransformer("<h2>(.*)</h2>", "h2. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
77 transformers.add(new TagTransformer("<h3>(accessing the program|sample run|sample screens?|sample reports?)</[h|H]3>","h3.", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
78 transformers.add(new TagTransformer("<h3>(.*)</H3>", "h3. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
79 transformers.add(new TagTransformer("<h3>(.*)</h3>", "h3. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
80 transformers.add(new TagTransformer("<h4>(.*)</h4>", "h4. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
81 transformers.add(new TagTransformer("<h5>(.*)</h5>", "h5. ", "")); |
22ed6d93442c
Start modifying transformers to Confluence wiki syntax
smith@nwoca.org
parents:
2
diff
changeset
|
82 transformers.add(new TagTransformer("<h6>(.*)</h6>", "h6. ", "")); |
8 | 83 |
84 //Replace Notes with Info tags. | |
10 | 85 transformers.add(new ReplaceTransformer("\\{center}\\n\\{table:border=\\d.*}\\n\\{tr\\}\\n\\s{2}\\{td\\}\\{center\\}\\*Note\\*\\{center\\}","{info}")); |
8 | 86 transformers.add(new ReplaceTransformer("\\{td\\}\\n\\s{2}\\{tr\\}\\n\\{table\\}\\n\\{center\\}","{info}")); |
5 | 87 |
8 | 88 //Remove unnecessary table surrounding code blocks. |
12 | 89 transformers.add(new ReplaceTransformer("\\{table:.*\\}\\n\\s{2}\\{tr\\}\\n\\s{4}\\{td\\}\\n\\s{6}\\n{0,1}\\{code\\}","{code}")); |
8 | 90 transformers.add(new ReplaceTransformer("\\{code\\}\\n\\{td\\}\\{tr\\}\\{table\\}","{code}")); |
91 | |
92 //Change borderStyle of code window for "screenshots" to none. | |
93 transformers.add(new TagTransformer("\\{code\\}([\\s\\n]*?_______________)", true, "{code:borderStyle=none}", "")); | |
94 | |
95 | |
96 | |
7
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
97 transformers.add(new TagTransformer("<blockquote>(.*?)</blockquote>", true, "{quote}", "{quote}")); |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
98 transformers.add(new DeleteTransformer("(?s)<hr.*?>")); |
8 | 99 transformers.add(new ReflowTransformer("(\\{info\\})([^\\{]*)(\\{info\\})")); |
12 | 100 transformers.add(new ReflowTransformer("(\\{note\\})([^\\{]*)(\\{note\\})")); |
101 transformers.add(new ReflowTransformer("(\\{td\\})([^\\{]*)(\\{td\\})")); | |
102 transformers.add(new ReflowTransformer("(\\{li\\})([^\\{]*)(\\{li\\})")); | |
7
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
103 transformers.add(new TagTransformer("<sup>(.*?)</sup>", true, "^\\[","\\]^ ")); |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
104 transformers.add(new ReplaceTransformer("<","<")); |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
105 transformers.add(new ReplaceTransformer(">",">")); |
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
106 transformers.add(new ReplaceTransformer(""","\"")); |
12 | 107 transformers.add(new ReplaceTransformer("&","&")); |
7
a634b4d554d4
Minor fixups >, random smilies :), etc. Fixed blockquote. Handle escaping brackets outside pre tag.
smith@nwoca.org
parents:
6
diff
changeset
|
108 transformers.add(new ReplaceTransformer(":\\)",": )")); // No smilies... |
11
8f23347884c0
Deal with double dashes surrounded by words. ReplaceTransformer can now replace specific group.
smith@nwoca.org
parents:
10
diff
changeset
|
109 transformers.add(new ReplaceTransformer("(\\w)(--)(\\w)"," -- ",2)); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
110 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
111 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
112 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
113 /** |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
114 * @param args the command line arguments |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
115 */ |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
116 public static void main(String[] args) throws IOException { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
117 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
118 if (args.length == 0) { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
119 System.out.println("Usage:"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
120 System.out.println(" Html2Wiki {inputDirectory} [Category]"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
121 System.out.println(" default is current directory"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
122 System.out.println(" Processes all *.html files. "); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
123 System.out.println(" Each 'chapter' written to *.wiki"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
124 return; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
125 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
126 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
127 File inputs = new File(args[0]); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
128 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
129 if (args.length > 1) { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
130 category = args[1]; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
131 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
132 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
133 File[] inputFiles = inputs.listFiles(new HtmlFileFilter()); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
134 for (int i = 0; i < inputFiles.length; i++) { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
135 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
136 process(inputFiles[i]); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
137 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
138 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
139 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
140 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
141 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
142 protected static void process(File input) throws IOException { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
143 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
144 System.out.println(input.getAbsoluteFile()); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
145 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
146 Html2Wiki converter = new Html2Wiki(FileUtils.readFileToString(input, null)); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
147 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
148 WikiChapter[] chapters = converter.getWikiChapters(); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
149 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
150 System.out.format("Writing %d wiki files...\n", chapters.length); |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
151 |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
152 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
153 for (int i = 0; i < chapters.length; i++) { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
154 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
155 FileUtils.writeStringToFile(new File(input.getParent(), |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
156 generateFilename(chapters[i].getChapterName()) + ".wiki"), |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
157 chapters[i].getContents().toString(), |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
158 null); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
159 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
160 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
161 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
162 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
163 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
164 public static String generateFilename(String input) { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
165 return input.replaceAll("\\\\|/|:|\\(|\\)", "-").replace("<br>", ""); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
166 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
167 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
168 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
169 public String getWikiText() { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
170 convert(); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
171 return buffer.toString(); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
172 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
173 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
174 public WikiChapter[] getWikiChapters() { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
175 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
176 convert(); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
177 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
178 List<WikiChapter> chapters = new ArrayList<WikiChapter>(); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
179 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
180 Pattern chapterPat = Pattern.compile("<chapter>"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
181 Matcher begin = chapterPat.matcher(buffer); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
182 Matcher end = chapterPat.matcher(buffer); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
183 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
184 while (begin.find()) { |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
185 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
186 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
187 end.find(begin.end()); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
188 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
189 Pattern chapterNamePat = Pattern.compile("<chapter>(.*?)</chapter>"); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
190 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
191 Matcher chapterNameMatcher = chapterNamePat.matcher(buffer); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
192 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
193 String chapterName = chapterNameMatcher.find(begin.start()) ? chapterNameMatcher.group(1) : null; |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
194 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
195 CharSequence contents = buffer.subSequence(chapterName == null ? begin.start() : chapterNameMatcher.end(), end.hitEnd() ? buffer.length() : end.start()); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
196 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
197 chapters.add(new WikiChapter(chapterName, contents)); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
198 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
199 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
200 return (WikiChapter[]) chapters.toArray(new WikiChapter[]{}); |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
201 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
202 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
203 private void convert() { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
204 |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
205 if (!converted) { |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
206 for (Transformer t : transformers) { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
207 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
208 System.out.println(".Applying: " + t); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
209 t.apply(buffer); |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
210 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
211 } |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
212 } |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
213 converted = true; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
214 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
215 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
216 private static class HtmlFileFilter implements FileFilter { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
217 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
218 public boolean accept(File pathname) { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
219 return pathname.getName().toLowerCase().matches("^.*\\.html$"); |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
220 } |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
221 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
222 |
2
5da2e67620f9
Upgrade to Ivy configuration and begin clean up of tests. Added FreeBSD license.
smith@nwoca.org
parents:
0
diff
changeset
|
223 protected static class WikiChapter { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
224 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
225 private String chapterName; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
226 private CharSequence contents; |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
227 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
228 public WikiChapter(String chapterName, CharSequence contents) { |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
229 this.chapterName = chapterName.replaceAll("\\\\|/|:|\\(|\\)", "-").replaceAll("\\s+", " ").replaceAll("&", "and"); |
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
230 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
231 this.contents = contents; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
232 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
233 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
234 public String getChapterName() { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
235 return chapterName; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
236 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
237 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
238 public CharSequence getContents() { |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
239 return contents; |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
240 } |
6
99f293bd507f
Add "reflow" transformer to reflow paragraphs, list items, etc.
smith@nwoca.org
parents:
5
diff
changeset
|
241 |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
242 public String toString() { |
2
5da2e67620f9
Upgrade to Ivy configuration and begin clean up of tests. Added FreeBSD license.
smith@nwoca.org
parents:
0
diff
changeset
|
243 return "Chapter: " + chapterName + " Content length: " + contents.length(); |
0
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
244 } |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
245 } |
f8b1ea49d065
Initial version of crude HTML to WikiText converter. Customized for converting HTML files from DEC Document into Wiki markup.
smith@nwoca.org
parents:
diff
changeset
|
246 } |