- SiSU - Description, Ralph Amissah -

- SiSU is a flexible document preparation, generation publishing and search system. ¹ -

- -

- - - - - - -

- -

- - - - -

- -

- SiSU -

- Description -

- Ralph Amissah - -

- copy @ - - SiSU - -

- - -

- -

- 1 -

- - -

- -

- 2 -

- - -

- -

- - -

- - 1. Description -

- 3 -

- - 1.1 Outline - -

- - 1.2 Short summary of features - -

- - 1.3 How it works - -

- - 1.4 Simple markup - -

- - 1.4.1 Sparse markup requirement, try to get the most out of markup - -

- - 1.4.2 Single markup file provides multiple output formats - -

- - 1.4.3 Syntax relatively easy to read and remember - -

- - 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types - -

- - 1.5 Designed with usability in mind - -

- - 1.6 Code separate from content - -

- - 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine - -

- - 1.8 Handling of Dublin Core meta-tags making use of the Resource Description Framework - -

- - 1.9 Easy directory management - -

- - 1.10 Document Version Control Information - -

- - 1.11 Table of contents - -

- - 1.12 Auto-numbering of headings - -

- - 1.13 Numbering and cross-hyperlinking of endnotes - -

- - 1.14 "Skinnable" - -

- - 1.15 Multiple Outputs - -

- - 1.15.1 html - several presentations: full length & segmented; css & table based - -

- - 1.15.2 XML - -

- - 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 - -

- - 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) - -

- - 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) - -

- - 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) - -

- - 1.15.7 Other forms - -

- - 1.16 Concordance / Word Map or rudimentary index - -

- - 1.17 Managed (document) directory, database, or site structure - -

- - 1.18 Batch processing - -

- - 1.19 Integration to superior Gnu/Linux and Unix tools - -

- - 1.19.1 Backup and version control - -

- - 1.19.2 Editor support - -

- - 1.20 Modular design, need something new add a module - -

- - -

- -

- 1.1 Outline -

- 4 -

- - -

- 5 -

- - -

- SiSU ("SiSU information Structuring Universe" or "Structured information, Serialized Units"), ² is a Unix command line oriented framework for document structuring, publishing and search. Featuring minimalistic markup, multiple standard outputs, a common citation system, and granular search. -

- 6 -

- - -

- Using markup applied to a document, SiSU can produce plain text, HTML, XHTML, XML, OpenDocument, LaTeX or PDF files, and populate an SQL database with objects ³ (equating generally to paragraph-sized chunks) so searches may be performed and matches returned with that degree of granularity (e.g. your search criteria is met by these documents and at these locations within each document). Document output formats share a common object numbering system for locating content. This is particularly suitable for "published" works (finalized texts as opposed to works that are frequently changed or updated) for which it provides a fixed means of reference of content. -

- 7 -

- - -

- SiSU is the data/information structuring and transforming tool, that has resulted from work on one of the oldest law web projects. It makes possible the one time, simple human readable markup of documents, that SiSU can then publish in various forms, suitable for paper ⁴ , web ⁵ and relational database ⁶ presentations, retaining common data-structure and meta-information across the output/presentation formats. Several requirements of legal and scholarly publication on the web have been addressed, including the age old need to be able to reliably cite/pinpoint text within a document, to easily make footnotes/endnotes, to allow for semantic document meta-tagging, and to keep required markup to a minimum. These and other features of interest are listed and described below. A few points are worth making early (and will be repeated a number of times): -

- 8 -

- - -

- (i) The SiSU document generator was the first to place material on the web with a system that makes possible citation across different document types, with paragraph, or rather object citation numbering ⁷ a text positioning system, available for the pinpointing of text, 1997, a simple idea from which much benefit, and SiSU remains today, to the best of my knowledge, the only multiple format e-book/ electronic-document system on the web that gives you this possibility (including for relational databases). -

- 9 -

- - -

- (ii) Markup is done once for the multiple formats produced. -

- 10 -

- - -

- (iii) Markup is simple, and human readable (with a little practice), in almost all cases there is less and simpler markup required than basic html. In any event the markup required is very much simpler than the html, LaTeX, [lout], structured XML, ODF (OpenDocument), PostgreSQL or SQLite feed etc. that you can have SiSU generate for you. -

- 11 -

- - -

- (iv) SiSU is a batch processor, dealing with as many files as you need to generate at a time. -

- 12 -

- - -

- (v) Scalability is dependent on your file system (in my case Reiserfs), the database (currently Postgresql and/or SQLite) and your hardware. -

- 13 -

- - -

- SiSU Sabaki ⁸ (or just SiSU) is the provisional name given to the software described here that helps structure documents for web and other publication. The name SiSU is a loose anagram for something along the lines of "SiSU is structuring unit", or "SiSU, information structuring unit" or the more descriptive "Structured information, Serialized Units" or "simple - information structuring unit" or the more descriptive "Structured information, Serialized Units" or what it may be directed towards "semantic and information structuring universe" , ⁹ tongue in cheek, only just. Guess I'll get away with "Simple - information Structuring Universe". SiSU is also a Finnish word roughly meaning guts, inner strength and perseverance. ¹⁰ -

- 14 -

- - -

- SiSU was born of the need to find a way, with minimal effort, and for as wide a range of document types as possible, to produce high quality publishing output in a variety of document formats. As such it was necessary to find a simple document representation that would work across a large number of document types, and the most convenient way(s) to produce acceptable output formats. The project leading to this program was started in 1993 (together with the trade law project now known as Lex Mercatoria) as an investigation of how to effectively/efficiently place documents on the web. The unified document handling, together with features such as paragraph numbering, endnote handling and tables... appeared in 1996/97. SiSU was originally written in Perl, ¹¹ and converted to Ruby, ¹² in 2000, one of the most impressive programming languages in existence! In its current form it has been written to run on the Gnu /Linux platform, and in particular on Debian, ¹³ taking advantage of many of the wonderful projects that are available there. -

- 15 -

- - -

- SiSU markup is based on requiring the minimum markup needed to determine the structure of a document. (This can be as little as saying in a header to look for the word Book at a specified level and the word Chapter at another level). SiSU then breaks a document into its smallest parts (at a heading, and paragraph level) while retaining all structural information. This break up of the document and information on its structure is taken advantage of in the transformations made in generating the very different output types that can be created, and in providing as much as can be for what each output type is best at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), ODF (OpenDocument [experimental]), SQL (e.g. document search; representing constituent parts of documents based on their structure, headings, chapters, paragraphs as required; user control). ¹⁴ -

- 16 -

- - -

- From markup that is simpler and more sparse than html you get: -

- 17 -

- - -

- far greater output possibilities, including html, XML, ODF (OpenDocument), LaTeX (pdf), and SQL; -

- 18 -

- - -

- the advantages implicit in the very different output possibilities; -

- 19 -

- - -

- a common citation system (for all outputs - including the relational database, search results are relevant for all outputs); -

- 20 -

- - -

- For more see the short summary of features provided below. -

- 21 -

- - -

- SiSU processes files with minimal tagging to produce various document outputs including html, LaTeX or lout (which is converted to pdf) and if required loads the structured information into an SQL database (PostgreSQL and SQLite have been used for this). SiSU produces an intermediate processing format. ¹⁵ -

- 22 -

- - -

- SiSU is used in constructing Lex Mercatoria <http://lexmercatoria.org/> or <http://www.jus.uio.no/lm/> (one of the oldest law web sites), and considerable thought went into producing output that would be suitable for legal and academic writings (that do not have formulae) given the limitations of html, and publication in a wide variety of "formats", in particular in relation to the convenient and accurate citation of text. However, the construction of Lex Mercatoria uses only a fraction of the features available from SiSU today, vis generation of flat file structures, rather than in addition the building of ("granular") SQL database content, (at an object level with relevant relational tables, and other outputs also available). -

- 23 -

- - -

- -

- 1.2 Short summary of features -

- 24 -

- - -

- (i) markup syntax: (a) simpler than html, (b) mnemonic, influenced by mail/messaging/wiki markup practices, (c) human readable, and easily writable, -

- 25 -

- - -

- (ii) (a) minimal markup requirement, (b) single file marked up for multiple outputs, -

- 26 -

- - -

- notes: -

- 27 -

- - -

- * documents are prepared in a single UTF-8 file using a minimalistic mnemonic syntax. Typical literature, documents like "War and Peace" require almost no markup, and most of the headers are optional. -

- 28 -

- - -

- * markup is easily readable/parsed by the human eye, (basic markup is simpler and more sparse than the most basic html), [this may also be converted to XML representations of the same input/source document]. -

- 29 -

- - -

- * markup defines document structure (this may be done once in a header pattern-match description, or for heading levels individually); basic text attributes (bold, italics, underscore, strike-through etc.) as required; and semantic information related to the document (header information, extended beyond the Dublin core and easily further extended as required); the headers may also contain processing instructions. -

- 30 -

- - -

- (iii) (a) multiple outputs primarily industry established and institutionally accepted open standard formats, include amongst others: plaintext (UTF-8); html; (structured) XML; ODF (Open Document text)l; LaTeX; PDF (via LaTeX); SQL type databases (currently PostgreSQL and SQLite). Also produces: concordance files; document content certificates (md5 or sha256 digests of headings, paragraphs, images etc.) and html manifests (and sitemaps of content). (b) takes advantage of the strengths implicit in these very different output types, (e.g. PDFs produced using typesetting of LaTeX, databases populated with documents at an individual object/paragraph level, making possible granular search (and related possibilities)) -

- 31 -

- - -

- (iv) outputs share a common numbering system (dubbed "object citation numbering" (ocn)) that is meaningful (to man and machine) across various digital outputs whether paper, screen, or database oriented, (PDF, html, XML, sqlite, postgresql), this numbering system can be used to reference content. -

- 32 -

- - -

- (v) SQL databases are populated at an object level (roughly headings, paragraphs, verse, tables) and become searchable with that degree of granularity, the output information provides the object/paragraph numbers which are relevant across all generated outputs; it is also possible to look at just the matching paragraphs of the documents in the database; [output indexing also work well with search indexing tools like hyperesteier]. -

- 33 -

- - -

- (vi) use of semantic meta-tags in headers permit the addition of semantic information on documents, (the available fields are easily extended) -

- 34 -

- - -

- (vii) creates organised directory/file structure for (file-system) output, easily mapped with its clearly defined structure, with all text objects numbered, you know in advance where in each document output type, a bit of text will be found (e.g. from an SQL search, you know where to go to find the prepared html output or PDF etc.)... there is more; easy directory management and document associations, the document preparation (sub-)directory may be used to determine output (sub-)directory, the skin used, and the SQL database used, -

- 35 -

- - -

- (viii) "Concordance file" wordmap, consisting of all the words in a document and their (text/ object) locations within the text, (and the possibility of adding vocabularies), -

- 36 -

- - -

- (ix) document content certification and comparison considerations: (a) the document and each object within it stamped with an md5 hash making it possible to easily check or guarantee that the substantive content of a document is unchanged, (b)version control, documents integrated with time based source control system, default RCS or CVS with use of $Id: sisu_description.sst,v 1.25 2007/08/23 12:22:36 ralph Exp $ tag, which SiSU checks -

- 37 -

- - -

- (x) SiSU's minimalist markup makes for meaningful "diffing" of the substantive content of markup-files, -

- 38 -

- - -

- (xi) easily skinnable, document appearance on a project/site wide, directory wide, or document instance level easily controlled/changed, -

- 39 -

- - -

- (xii) in many cases a regular expression may be used (once in the document header) to define all or part of a documents structure obviating or reducing the need to provide structural markup within the document, -

- 40 -

- - -

- (xiii) prepared files may be batch process, documents produced are static files so this needs to be done only once but may be repeated for various reasons as desired (updated content, addition of new output formats, updated technology document presentations/representations) -

- 41 -

- - -

- (xiv) possible to pre-process, which permits: the easy creation of standard form documents, and templates/term-sheets, or; building of composite documents (master documents) from other sisu marked up documents, or marked up parts, i.e. import documents or parts of text into a main document should this be desired -

- 42 -

- - -

- there is a considerable degree of future-proofing, output representations are "upgradeable", and new document formats may be added. -

- 43 -

- - -

- (xv) there is a considerable degree of future-proofing, output representations are "upgradeable", and new document formats may be added: (a) modular, (thanks in no small part to Ruby) another output format required, write another module.... (b) easy to update output formats (eg html, XHTML, LaTeX/PDF produced can be updated in program and run against whole document set), (c) easy to add, modify, or have alternative syntax rules for input, should you need to, -

- 44 -

- - -

- (xvi) scalability, dependent on your file-system (ext3, Reiserfs, XFS, whatever) and on the relational database used (currently Postgresql and SQLite), and your hardware, -

- 45 -

- - -

- (xvii) only marked up files need be backed up, to secure the larger document set produced, -

- 46 -

- - -

- (xviii) document management, -

- 47 -

- - -

- (xix) Syntax highlighting for SiSU markup is available for a number of text editors. -

- 48 -

- - -

- (xx) remote operations: (a) run SiSU on a remote server, (having prepared sisu markup documents locally or on that server, i.e. this solution where sisu is installed on the remote server, would work whatever type of machine you chose to prepare your markup documents on), (b) generated document outputs may be posted by sisu to remote sites (using rsync/scp) (c)document source (plaintext utf-8) if shared on the net may be identified by its url and processed locally to produce the different document outputs. -

- 49 -

- - -

- (xxi) document source may be bundled together (automatically) with associated documents (multiple language versions or master document with inclusions) and images and sent as a zip file called a sisupod, if shared on the net these too may be processed locally to produce the desired document outputs, these may be downloaded, shared as email attachments, or processed by running sisu against them, either using a url or the filename. -

- 50 -

- - -

- (xxii) for basic document generation, the only software dependency is Ruby, and a few standard Unix tools (this covers plaintext, html, XML, ODF, LaTeX). To use a database you of course need that, and to convert the LaTeX generated to PDF, a LaTeX processor like tetex or texlive. -

- 51 -

- - -

- as a developers tool it is flexible and extensible -

- 52 -

- - -

- SiSU was developed in relation to legal documents, and is strong across a wide variety of texts (law, literature...). SiSU handles images but is not suitable for formulae/ statistics, or for technical writing at this time. -

- 53 -

- - -

- SiSU has been developed and has been in use for several years. Requirements to cover a wide range of documents within its use domain have been explored. -

- 54 -

- - -

- Some modules are more mature than others, the most mature being Html and LaTeX / pdf. PostgreSQL and search functions are useable and together with ocn unique (to the best of my knowledge). The XML output document set is "well formed" but largely proof of concept. -

- 55 -

- - -

- -

- 1.3 How it works -

- 56 -

- - -

- SiSU markup is fairly minimalistic, it consists of: a (largely optional) document header, made up of information about the document (such as when it was published, who authored it, and granting what rights) and any processing instructions; and markup within text which is related to document structure and typeface. SiSU must be able to discern the structure of a document, (text headings and their levels in relation to each other), either from information provided in the instruction header or from markup within the text (or from a combination of both). Processing is done against an abstraction of the document comprising of information on the document's structure and its objects, ¹⁶ which the program serializes (providing the object numbers) and which are assigned hash sum values based on their content. This abstraction of information about document structure, objects, (and hash sums), provides considerable flexibility in representing documents different ways and for different purposes (e.g. search, document layout, publishing, content certification, concordance etc.), and makes it possible to take advantage of some of the strengths of established ways of representing documents, (or indeed to create new ones). -

- 57 -

- - -

- -

- 1.4 Simple markup -

- 58 -

- - -

- SiSU markup is based on requiring the minimum markup needed to determine the structure of a document. (This can be as little as saying in a header to look for the word Book at a specified level and the word Chapter at another level). SiSU then breaks a document into its smallest parts (at a heading, and paragraph level) while retaining all structural information. This break up of the document and information on its structure is taken advantage of in the transformations made in generating the very different output types that can be created, and in providing as much as can be for what each output type is best at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), ODF (OpenDocument), SQL (e.g. document search; representing constituent parts of documents based on their structure, headings, chapters, paragraphs as required; user control). ¹⁷ -

- 59 -

- - -

- -

- 1.4.1 Sparse markup requirement, try to get the most out of markup -

- 60 -

- - -

- One of its strengths is that very small amounts of initial tagging is required for the program to generate its output. -

- 61 -

- - -

- This is a basic markup example: -

- 62 -

- - -

- basic markup example, text file - an international convention ¹⁸ -

- 63 -

- - -

- view basic markup, as it would be highlighted by vim editor ¹⁹ -

- 64 -

- - -

- Emphasis has been on simplicity and minimalism in markup requirements. Design philosophy is to try keep the amount of markup required low, for whatever has been determined to be acceptable output. ²⁰ -

- 65 -

- - -

- SiSU's markup is more minimalistic and simpler than (the equivalent) html and for it, you get considerably more than just html, as this preparation gives you all available output formats, upon request. -

- 66 -

- - -

- -

- 1.4.2 Single markup file provides multiple output formats -

- 67 -

- - -

- For each document, there is only one (input, minimalistically marked up) file from which all the available output types are generated. ²¹ -

- 68 -

- - -

- Eg. the markup example: -

- 69 -

- - -

- original text file - an international convention ²² -

- 70 -

- - -

- view as syntax would be highlighted by vim editor ²³ -

- 71 -

- - -

- Produces the following output: -

- 72 -

- - -

- Segmented html version of document ²⁴ -

- 73 -

- - -

- Full length html document ²⁵ -

- 74 -

- - -

- pdf landscape version of document ²⁶ -

- 75 -

- - -

- pdf portrait version of document ²⁷ -

- 76 -

- - -

- clean tex ascii version of document ²⁸ -

- 77 -

- - -

- xml sax version of document ²⁹ -

- 78 -

- - -

- xml dom version of document ³⁰ -

- 79 -

- - -

- Concordance ³¹ -

- 80 -

- - -

- (and in addition to these: PostgreSQL, SQLite, texinfo and ~~YAML~~ ³² versions if desired) -

- 81 -

- - -

- -

- 1.4.3 Syntax relatively easy to read and remember -

- 82 -

- - -

- Syntax is kept simple and mnemonic. ³³ -

- 83 -

- - -

- -

- 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types -

- 84 -

- - -

- To keep SiSU markup sparse and simple SiSU deliberately provides a limited publishing feature set, including: indent levels; bold; italics; superscript; subscript; simple tables; images; tables of contents and; endnotes. Which in most cases are available across the different output formats. -

- 85 -

- - -

- The publishing feature set may be expanded as required. -

- 86 -

- - -

- -

- 1.5 Designed with usability in mind -

- 87 -

- - -

- Output is designed to be uniform, easy to read, navigate and cite. -

- 88 -

- - -

- -

- 1.6 Code separate from content -

- 89 -

- - -

- Code ³⁴ is separated from content. This means that when changes are desired in the output presentation, the code that produces them, and not the marked up text data set (which could be thousands of documents) is modified. Separating code from content makes large scale changes to output appearance trivial, and permits the easy addition of new output modules. -

- 90 -

- - -

- -

- 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine -

- 91 -

- - -

- Object citation numbering is a simple object (text) positioning and cition system that is human relevant and machine useable, used by SiSU for all manner of presentations, and that is available for use in all text mappings. It is based on the automated sequential numbering of objects (roughly paragraphs, (headings, tables, verse) or other blocks of text or images etc.). The text positioning system (in which I claim copyright) is invaluable for publishing requiring the citing text across multiple output formats, and for the general mapping of text within a document: -

- 92 -

- - -

- in html, html not being easily citeable (change font size, or use a different browser and the page on which specific text appears has changed), and -

- 93 -

- - -

- across multiple formats being common to all output formats html/xml/pdf/sql output, -

- 94 -

- - -

- the results of an sql search can just be "live" citation references to the documents in which the text is found, much like an index (see image examples provided). ³⁵ -

- 95 -

- - -

- I claim copyright on the system I use which is the most basic of all, numbering all text in headings and paragraphs sequentially (with tables and images being treated as a single paragraph) and only footnotes/endnotes not following this numbering, as their position in text is not strictly determined, (a change from footnotes to endnotes would change their numbering), footnotes instead "belong" to the paragraph from which they are referenced, and have sequential numbers of their own. -

- 96 -

- - -

- SiSU has a paragraph numbering system, that remains the same regardless of the output format. This provides an effective means of citation, pinpointing text accurately in all output formats, using the same reference. This is particularly useful where text has to be located across different output formats - for example once html is printed the number of pages and pages on which given text is found will vary depending on the browser, its settings the font size setting etc. Similarly SiSU produces pdf in different forms, eg. on the example site Lex Mercatoria as portrait and landscape documents - here too page numbering varies, but paragraph numbering is the same, vis a vis all versions of the text (portrait and landscape pdf and the html versions of the text, and as stored (with "paragraphs" as records) to the PostgreSQL or SQLite database). -

- 97 -

- - -

- These numbers are placed in the text margins and are intended to be independent of and not to interfere with authors tagging. [The citation system (object citation numbering system, automated "paragraph numbering") which is automatically generated and is common and identical across all document formats] The paragraph numbering system is more accurately described as an (text) object numbering system, as headings are also numbered... all headings and paragraphs are numbered sequentially. Endnotes are automatically numbered independently and rather "belong" to the paragraph from which they are referenced, as an endnote does not (necessarily) form a part of a documents sequence, (they may be produced as either endnotes or footnotes (or both depending on what output you choose to look at - if you take the segmented html version document provided as an example, you will find that the endnotes are placed both at the end of each section, and in a separate section of their own called endnotes, and these are hyper-linked)). An attractive feature of providing citation numbering in this way is that it is independent of the document structure... it remains the same regardless of what is done about the document structure. -

- 98 -

- - -

- The rules have been kept very simple, unique incremental object citation numbers are assigned to headings, paragraphs, verse, tables and images. It is possible to manually override this feature on a per heading or comment basis though this should be used exceptionally, it may be of use where there a substantive text, and the addition of a minor comment by the publisher that should not be mapped as part of the text. -

- 99 -

- - -

- The object citation number markers contain additional numbering information with regard to the document structure, that can be used for alternative presentations, including such detail as the type of object (heading, paragraph, table, image, etc.), numbered sequentially. -

- 100 -

- - -

- An advantage is that the numbering remains the same regardless of document structure. -

- 101 -

- - -

- Text object ("paragraph") numbering is the same for all output versions of the same document, vis html, pdf, pgsql, yaml etc. -

- 102 -

- - -

- In the relational database, as individual text objects of a document stored (and indexed) together with object numbers, and all versions of the document have the same numbering, the results of searches may be tailored just to provide the location of the search result in all available document formats. -

- 103 -

- - -

- Note: there is a bug in the released behaviour of object citation numbering, (not certain when it was introduced) tables should be numbered, ie each table gets an ocn, required amongst other things for relational database. This will be corrected in a future release. Citation numbering of existing documents that contain tables will changed. -

- 104 -

- - -

- -

- 1.8 Handling of Dublin Core meta-tags making use of the Resource Description Framework -

- 105 -

- - -

- SiSU is able to use meta tags based on the Dublin Core ³⁶ and Resource Description Framework ³⁷ -

- 106 -

- - -

- This provides the means of providing semantic information about a document, both as computer processable meta-tags, and as human readable information that may be of value for classification purposes. -

- 107 -

- - -

- This information is provided both in html metatags, and (where available) under the section titled "Document Information - MetaData", near the end of a document, for example in the segmented html version of this text at: <http://www.jus.uio.no/sisu/SiSU/metadata.html> -

- 108 -

- - -

- -

- 1.9 Easy directory management -

- 109 -

- - -

- 1. Directory file association, skins and special image management, made simpler. ³⁸ -

- 110 -

- - -

- The last part of the name of the work directory in which markup is being done, or rather from where SiSU is run in order to generate document output, is used in determining the sub-directory name for output files, that is created in the document output directory. This provides a rather easy way to associate documents e.g. of a given subject, or by owner. -

- 111 -

- - -

-   /www/docs
      /intellectual_property
      /arbitration
      /contract_law

  /www/docs
      /ralph
      /sisu -

- 112 -

- - -

- all are placed in their own directories within the directory structure created. Similar rules are used in the creation of sql type databases (though they can be overridden). -

- 113 -

- - -

- There are a couple of further associations with these directories. -

- 114 -

- - -

- Directory wide skins. -

- 115 -

- - -

- Directory specific images. -

- 116 -

- - -

- 2. If there is a "directory skin", that is a skin of the same name as the directory, it is used in the generation of the documents within it, rather than the default skin, unless the document has a specific skin associated with it. -

- 117 -

- - -

- a. default skin (always available) -

- 118 -

- - -

- b. directory skin (precedence over default if exists) -

- 119 -

- - -

- c. document skin (takes precedence wherever document requests a specific skin) -

- 120 -

- - -

- Skins are defined in the document skin directory and if a directory association is desired a softlink made to the relevant skin. Skins (directory association auto load) auto load skin if a directory skin exists of same name as directory stub, (and there is no specific doc skin) -

- 121 -

- - -

- 3. If the working directory has within it a sub-directory called image_local, the images within that directory are used for references to images, that are not part of the default site build. -

- 122 -

- - -

- -

- 1.10 Document Version Control Information -

- 123 -

- - -

- The possibility of citing an exact document version. -

- 124 -

- - -

- Permits the inclusion of document version control information to the document body and metatags. ³⁹ This provides a much more certain method of referring to the exact version of a particular document, (assuming that the document is from a trusted source, that will retain earlier versions of a document). ⁴⁰ -

- 125 -

- - -

- This information (where available) is provided under the section of the document titled "Document Information - MetaData", near the end of a document, for example in the segmented html version of this text at: <http://www.jus.uio.no/sisu/SiSU/metadata.html> -

- 126 -

- - -

- -

- 1.11 Table of contents -

- 127 -

- - -

- SiSU produces a rudimentary a table of contents based on document headings. -

- 128 -

- - -

- -

- 1.12 Auto-numbering of headings -

- 129 -

- - -

- Headings can be automatically numbered, (and automatically named for hyper-linking) -

- 130 -

- - -

- -

- 1.13 Numbering and cross-hyperlinking of endnotes -

- 131 -

- - -

- SiSU can automatically number footnotes/endnotes. This is the default operation where no number is provided. -

- 132 -

- - -

- Footnotes/endnotes may also be manually numbered. Where a number, or numbers are provided for a footnote/endnote, this does not increment the automatic footnote/endnote number counter. -

- 133 -

- - -

- In the html output footnotes/endnotes are cross-hyper-linked (to their reference point and vice versa). In th pdf output footnotes are linked from their reference point only. -

- 134 -

- - -

- -

- 1.14 "Skinnable" -

- 135 -

- - -

- SiSU is skinnable, on a site-wide, directory-wide and per document basis, so different looking versions of things may be produced with little difficulty. There is a default skin which may be modified, as the background site skin, and each working directory may have a skin associated with it, as may each individual document. The hierarchy of application is document, directory, then site... ie if a document skin exists it gets precedence. -

- 136 -

- - -

- Whilst it is skinnable, the default output styles are selected to work across the widest possible range of document types. -

- 137 -

- - -

- -

- 1.15 Multiple Outputs -

- 138 -

- - -

- From markup that is simpler and more sparse than html you get: -

- 139 -

- - -

- far greater output possibilities, including multiple html types, XML (different structured types), LaTeX (pdf landscape, portrait), and SQL (Postgresql or SQLite or other); -

- 140 -

- - -

- the advantages implicit in these very different output possibilities; ⁴¹ -

- 141 -

- - -

- a common citation system -

- 142 -

- - -

- As many output formats/presentations as one cares to write modules for - several types of html (e.g. structure based on css, or structure based on tables); LaTeX/pdf and Lout/pdf; pgsql other databases easily added; yaml... -

- 143 -

- - -

- -

- 1.15.1 html - several presentations: full length & segmented; css & table based -

- 144 -

- - -

- Most documents are produced in single and segmented html versions, described below: -

- 145 -

- - -

- The Scroll (full length text presentations) -

- 146 -

- - -

- The full length of the text in a single scrollable document. ⁴² As a rule the files they are saved in are named: doc or more precisely doc.html -

- 147 -

- - -

- For various reasons texts may only be provided in this form (such as this one which is short), though most are also provided as segmented texts. -

- 148 -

- - -

- "Scroll" is a reference to the historical scroll, a single long document/ parchment, and also no doubt to what you will have to do to get to the bottom of the text. ⁴³ -

- 149 -

- - -

- The Segmented Text -

- 150 -

- - -

- The text divided into segments (such as articles or chapters depending on the text) ⁴⁴ As a rule the files they are saved in are named: toc and index or more precisely toc.html and index.html -

- 151 -

- - -

- If you know exactly what you are looking for, loading a segment of text is faster (the segments being smaller). Occasionally longer documents such as the WTA 1994 <http://www.jus.uio.no/lm/wta.1994/toc> are only provided in segmented form. -

- 152 -

- - -

- Cascading Style Sheet, and Table based html -

- 153 -

- - -

- SiSU outputs html, two current standard forms available are: -

- 154 -

- - -

- css based -

- 155 -

- - -

- and -

- 156 -

- - -

- table based [largely discontinued ] ⁴⁵ -

- 157 -

- - -

- The html is tested across several browsers -

- 158 -

- - -

- I like to remind you that there are other excellent browsers out there, many of which have long supported practical features like tabbing. -

- 159 -

- - -

- The html is tested across several browsers, including: -

- 160 -

- - -

- Firefox (Mozilla-Firefox) ⁴⁶ -

- 161 -

- - -

- Kazehakase ⁴⁷ -

- 162 -

- - -

- Konqueror ⁴⁸ -

- 163 -

- - -

- Mozilla ⁴⁹ -

- 164 -

- - -

- MS Internet Explorer ⁵⁰ -

- 165 -

- - -

- Netscape ⁵¹ -

- 166 -

- - -

- Opera ⁵² -

- 167 -

- - -

- Also lighter weight graphical browsers: -

- 168 -

- - -

- Dillo ⁵³ -

- 169 -

- - -

- Epiphany ⁵⁴ -

- 170 -

- - -

- Galeon ⁵⁵ -

- 171 -

- - -

- And for console/text browsing: -

- 172 -

- - -

- elinks ⁵⁶ -

- 173 -

- - -

- links2 ⁵⁷ -

- 174 -

- - -

- w3m ⁵⁸ -

- 175 -

- - -

- The html tables output is rendered more accurately across a wider variety set and older versions of browsers (than the html css output). -

- 176 -

- - -

- -

- 1.15.2 XML -

- 177 -

- - -

- SiSU generates well formed XML, and multiple versions. An XML SAX version with a flat/shallow structure, and XML DOM version with a deeper (embedded) structure. There is also a released working xhtml module. Examples of SAX and DOM versions are provided within this document. -

- 178 -

- - -

- -

- 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 -

- 179 -

- - -

- SiSU generates Open Document Output format. -

- 180 -

- - -

- -

- 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) -

- 181 -

- - -

- SiSU outputs LaTeX if required which is easily transformed to PDF. ⁵⁹ PDF documents are generated on the site from the same source files and Ruby program that produce html. Landscape oriented pdf introduced, providing easier screen viewing, they are also (paper saving, being currently) formatted to have fewer pages than their portrait equivalents. -

- 182 -

- - -

- Adobe Reader ⁶⁰ -

- 183 -

- - -

- Evince ⁶¹ -

- 184 -

- - -

- xpdf ⁶² -

- 185 -

- - -

- -

- 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) -

- 186 -

- - -

- SiSU (from the same markup input file) automatically feeds into PostgreSQL ⁶³ and/or SQLite ⁶⁴ database (could be any other of the better relational databases) ⁶⁵ - together with all additional information related to document structure, and the alternative ways in which it is generated on the site retained. As regards scaling of the database, it is as scalable as the database (here Postgresql or SQLite) and hardware allow. I will prune the images later. -

- 187 -

- - -

- This is one of the more interesting output forms, as all the structural data for the documents are retained (though can be ignored by the user of the database should they so choose). All site texts/documents are (currently) streamed to four pgsql database tables: -

- 188 -

- - -

- one containing semantic (and other) headers, including, title, author, subject, (the Dublin Core...); -

- 189 -

- - -

- another the substantive texts by individual "paragraph" (or object) - along with structural information, each paragraph being identifiable by its paragraph number (if it has one which almost all of them do), and the substantive text of each paragraph quite naturally being searchable (both in formatted and clean text versions for searching); and -

- 190 -

- - -

- a third containing endnotes cross-referenced back to the paragraph from which they are referenced (both in formatted and clean text versions for searching). -

- 191 -

- - -

- a fourth table with a one to one relation with the headers table contains full text versions of output, eg. pdf, html, xml, and ascii. -

- 192 -

- - -

- There is of course the possibility to add further structures. -

- 193 -

- - -

- At this level SiSU loads a relational database with documents broken in to their smallest logical structurally constituent parts, as text objects, with their object citation number and all other structural information needed to construct the structured document. Text is stored (at this text object level) with and without elementary markup tagging, the stripped version being so as to facilitate ease of searching. -

- 194 -

- - -

- Because the document structure of sites created is clearly defined, and the text object citation system is available for all forms of output, it is possible to search the sql database, and either read results from that database, or just as simply map the results to the html output, which has richer text markup. -

- 195 -

- - -

- The combination of the SiSU citation system with a relational database is pretty powerful, giving rise to several possibilities. As individual text objects of a document stored (and indexed) together with object numbers, and all versions of the document have the same numbering, complex searches can be tailored to return just the locations of the search results relevant for all available output formats, with live links to the precise locations in the database or in html/xml documents; or, the structural information provided makes it possible to search the full contents of the database and have headings in which search content appears, or to search only headings etc. (as the Dublin Core is incorporated it is easy to make use of that as well). -

- 196 -

- - -

- This is a larger scale project, (with little development on the front end largely ignored), though the "infrastructure" has been in place since 2002. -

- 197 -

- - -

- -

- 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) -

- 198 -

- - -

- Sample search frontend ⁶⁶ A small database and sample query front-end (search from) that makes use of the citation system, object citation numbering to demonstrates functionality. ⁶⁷ -

- 199 -

- - -

- SiSU can provide information on which documents are matched and at what locations within each document the matches are found. These results are relevant across all outputs using object citation numbering, which includes html, XML, LaTeX, PDF and indeed the SQL database. You can then refer to one of the other outputs or in the SQL database expand the text within the matched objects (paragraphs) in the documents matched. -

- 200 -

- - -

- (further work needs to be done on the sample search form, which is rudimentary and only passes simple booleans correctly at present to the SQL engine) -

- 201 -

- - -

- A few canned searches, showing object numbers. Search for: -

- 202 -

- - -

- 203 -

- - -

- 204 -

- - -

- 205 -

- - -

- Note that the searches done in this form are case sensitive. -

- 206 -

- - -

- 207 -

- - -

- Expand those same searches, showing the matching text in each document: -

- 208 -

- - -

- 209 -

- - -

- 210 -

- - -

- 211 -

- - -

- Note you may set results either for documents matched and object number locations within each matched document meeting the search criteria; or display the names of the documents matched along with the objects (paragraphs) that meet the search criteria. ⁶⁸ -

- 212 -

- - -

- 213 -

- - -

- OCN index mode, (object citation number) the numbers displayed are relevant (and may be used to reference the match) in any sisu generated rendition of the text ⁶⁹ the links provided are to the locations of matches within the html generated by SiSU. -

- 214 -

- - -

- Paragraph mode, you may alternatively display the text of each paragraph in which the match was made, again the object/paragraph numbers are relevant to any SiSU generated/published text. -

- 215 -

- - -

- Several options for output - select database to search, show results in index view (links to locations within text), show results with text, echo search in form, show what was searched, create and show a "canned url" for search, show available search fields. Also shows counters number of documents in which found and number of locations within documents where found. [could consider sorting by document with most occurrences of the search result]. -

- 216 -

- - -

- Earlier version of the search frontend - Simple search, results with files in which search found, and locations where found within files. -

- 217 -

- - -

- Simple search, results with files in which search found, and text object (paragraph or endnote) where found within files. -

- 218 -

- - -

- -

- 1.15.7 Other forms -

- 219 -

- - -

- There are other forms as well, YAML file, Ruby Marshal dumps, document pre-processing (processing of documents prior to the steps described here, to produce input suitable for the program) snap in a new module as required/desired, well formed XML, no problem. -

- 220 -

- - -

- -

- 1.16 Concordance / Word Map or rudimentary index -

- 221 -

- - -

- Concordance /WordMaps: ⁷⁰ SiSU produces a rudimentary index based on the words within the text, making use of paragraph numbers to identify text locations. This is generated in html and hyper-linked but identifies these words locations in the other document formats. Though it is possible to search using a search engine, this is a means for browsing an alphabetical list of words which may suggest other useful content. -

- 222 -

- - -

- -

- 1.17 Managed (document) directory, database, or site structure -

- 223 -

- - -

- SiSU builds the web site (or more generically provides a suitable directory structure) - placing various output texts in the hierarchy of the web-site (or db), which (for directories) is a sub-directory with the name of the text file. -

- 224 -

- - -

- -

- 1.18 Batch processing -

- 225 -

- - -

- SiSU is a batch processing tool, handling and transforming multiple (or individual) documents (in many ways) with a single instruction. -

- 226 -

- - -

- -

- 1.19 Integration to superior Gnu/Linux and Unix tools -

- 227 -

- - -

- As should have been noted by the above description of SiSU, it makes use of existing programs found on Gnu /Linux and Unix, amongst those already mentioned include the LaTeX to pdf converters and the database PostgreSQL or SQLite. -

- 228 -

- - -

- -

- 1.19.1 Backup and version control -

- 229 -

- - -

- Unix provides many tools for version control. For documents Subversion, CVS and even the old RCS are useful for the per-document histories they provide. -

- 230 -

- - -

- For writing code superior (more recent) version control system exist. These can also be used for documents though they tend to take stamps of changes across the repository as a whole, rather than for each individual file that is tracked, (as CVS and RCS do). My personal preference is for distributed systems such as Git, Mercurial or Darcs, of which I use Git for both code and documents. -

- 231 -

- - -

- Several backup tools exist. At the base level I tend to use rdiff. -

- 232 -

- - -

- -

- 1.19.2 Editor support -

- 233 -

- - -

- SiSU documents are prepared / marked up in utf-8 text you are free to use the text editor of your choice. -

- 234 -

- - -

- Syntax highlighting for a number of editors are provided. Amongst them Vim, Kwrite, Kate, Gedit and diakonos. These may be found with configuration instructions at <http://www.jus.uio.no/sisu/syntax_highlight>. Vim ⁷¹ as of version 7 has built in sytax highlighting for SiSU. -

- 235 -

- - -

- -

- 1.20 Modular design, need something new add a module -

- 236 -

- - -

- Need a new output format that does not already exist, write a new module. -

- 237 -

- - -

- Prefer a new input syntax, you could write a new syntax matching the existing design, though my personal preference is some uniformity in entry appearance. If necessary has been fairly easy to extend the design parameters. It is intended to incorporate some additional basic semantic tagging, (book, article, author etc.) However, keeping the requirements for input minimal, and relatively simple has been a design goal. -

- 238 -

- - -

- ^1. This information was first placed on the web 12 November 2002; with predating material taken from <http://www.jus.uio.no/lm/lm.information/toc.html> part of a site started and developed since 1993. See document metadata section <http://www.jus.uio.no/sisu/SiSU/metadata.html> for information on this version. Dates related to the development of SiSU are mostly contained within the Chronology section of this document, e.g. <http://www.jus.uio.no/sisu/sisu_chronology> -

- - -

- ^2. also chosen for the meaning of the Finnish term "sisu". -

- - -

- ^3. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- - -

- ^4. pdf via LaTeX or lout -

- - -

- ^5. currently html (two forms of html presentation one based on css the other on tables), and PHP; potentially structured XML -

- - -

- ^6. any SQL - currently PostgreSQL and sqlite (for portability, testing and development) -

- - -

- ^7. previously called "text object numbering" -

- - -

- ^8. SiSU Sabaki, release version. Pre-release version SiSU Scribe, and version prior to that SiSU nicknamed Scribbler. Pre-release versions go back several years. Both Scribbler and Scribe (still maintained) made system calls to SiSU's various parts, instead of using libraries. -

- - -

- ^9. A little universe it may be, but semantic you may have a hard time getting away with, given the meaning the word has taken on with markup. On a document wide basis semantic information may be provided, which can be really useful, (and meaningful, especially) if you have a large document set, and use this with rss feeds or in an sql database etc. On a markup level, I have little inclination to add semantic markup formally beyond references, title, author [Dublin Core entities? addresses?] etc. Actually this deserves a bit of thought possibly use letter tags (including letter alias/synonyms for font faces) to create a small set of default semantic tags, with the possibility for per document adjustments. Will seek to permit XML entity tagging, within SiSU markup and have that ignored/removed by the parts of the program that have no use for it. -

- - -

- <http://www.humanlanguages.com/finnishenglish/rlfs.htm> -

- - -

- "Every Finn has his own pet definition. To me, sisu means patience without passion. But there are many varieties of sisu. Sisu can be a sudden outburst or it can be the kind that lasts. A man can have both kinds. It is outside reason. It is something in the soul. It comes from oneself. For instance, it makes a soldier do things because he himself must, not because he has been told." Paavo Nurmi -

- - -

- <http://personalweb.smcvt.edu/tmatikainen/finnishtraditions.htm> -

- - -

- ^11. <http://www.perl.org/> -

- - -

- ^12. <http://www.ruby-lang.org/en/> -

- - -

- ^13. <http://www.debian.org/> -

- - -

- ^14. where explicit structure is provided through the use of tagging headings, it could be reduced (still) further, for example by reducing the number of characters used to identify heading levels; but in many cases even that information is not required as regular expressions can be used to extract the implicit structure. -

- - -

- ^15. This proved to be the easiest way to develop syntax, changes could be made, or alternatives provided for the markup syntax whilst the intermediate markup syntax was largely held constant. There is actually an optional second intermediate markup format in YAML <http://www.yaml.org/> -

- - -

- ^16. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- - -

- ^17. where explicit structure is provided through the use of tagging headings, it could be reduced (still) further, for example by reducing the number of characters used to identify heading levels; but in many cases even that information is not required as regular expressions can be used to extract the implicit structure. -

- - -

- ^18. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> output provided as example in the next section -

- - -

- ^19. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> as it would appear with syntax highlighting (by vim) -

- - -

- ^20. seems there are several "smart ASCIIs" available, primarily for ascii to html conversion, that make this, and reasonable looking ascii their goal -

- - -

- <http://webseitz.fluxent.com/wiki/SmartAscii> -

- - -

- <http://daringfireball.net/projects/markdown/> -

- - -

- <http://www.textism.com/tools/textile/> -

- - -

- ^21. These include richly laid out and linked html (table or css variants), PHP, LaTeX (from which pdf portrait and landscape documents are produced), texinfo (for info files etc.), and PostgreSQL and/or SQLite. And the opportunity to fairly easily build additional modules, such as XML. See the examples provided in this document. -

- - -

- ^22. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> -

- - -

- ^23. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> -

- - -

- ^24. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/toc.html> -

- - -

- ^25. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/doc.html> -

- - -

- ^26. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/landscape.pdf> -

- - -

- ^27. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/portrait.pdf> -

- - -

- ^28. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/plain.txt> -

- - -

- ^29. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/sax.xml> -

- - -

- ^30. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/dom.xml> -

- - -

- ^31. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/concordance.html> -

- - -

- ^32. discontinued for the time being -

- - -

- ^33. SiSU markup syntax, an incomplete summary: <http://www.jus.uio.no/sisu/sisu_markup_table/doc.html#h200306> -

- - -

- Visual check of elementary font face modifiers: bold bold emphasis italics underscore ~~strikethrough~~ ^superscript _subscript -

- - -

- ^34. the program that generates the documents -

- - -

- ^35. <http://www.jus.uio.no/sisu/SiSU/1.html#search> -

- - -

- ^36. <http://dublincore.org/> -

- - -

- ^37. <http://www.w3.org/RDF/> -

- - -

- ^38. The previous way was directory associations for file output were set up in the configuration file. The present system is a more natural way to work requireing less configuration. -

- - -

- ^39. from a version control system such as CVS -

- - -

- ^40. The version control system must be run, so the version number is obtained, prior to the SiSU document generation, and subsequent posting of the document. -

- - -

- ^41. e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), SQL (e.g. document set searches; representation of the constituent parts of documents based on their structure, headings, chapters, paragraphs as desired; control of use) -

- - -

- ^42. CISG <http://www.jus.uio.no/lm/un_contracts_international_sale_of_goods_convention_1980/doc> -

- - -

- The Unidroit Contract Principles <http://www.jus.uio.no/lm/unidroit.contract.principles.1994/doc> or -

- - -

- The Autonomous Contract <http://www.jus.uio.no/lm/autonomous.contract.2000.amissah/doc> -

- - -

- ^43. Scrolling is not however necessarily confined to full length documents as you will have to scroll to get to the bottom of any long segment (eg. chapter) of a segmented text. -

- - -

- ^44. CISG <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980> -

- - -

- The Unidroit Principles <http://www.jus.uio.no/lm/unidroit.contract.principles.1994> -

- - -

- The Autonomous Contract <http://www.jus.uio.no/sisu/the.autonomous.contract.2000.amissah> or -

- - -

- WTA 1994 <http://www.jus.uio.no/lm/wta.1994> -

- - -

- ^45. formatting possibility still exists in code tree but maintenance has been largely discontinuted. -

- - -

- ^46. <http://www.mozilla.org/products/firefox/> -

- - -

- ^47. <http://kazehakase.sourceforge.jp/> -

- - -

- ^48. <http://www.konqueror.org/> -

- - -

- ^49. <http://www.mozilla.org/> -

- - -

- ^50. <http://www.microsoft.com/windows/ie/default.asp> -

- - -

- ^51. <http://home.netscape.com/comprod/mirror/client_download.html> -

- - -

- ^52. <http://www.opera.com/> -

- - -

- ^53. <http://www.dillo.org/> -

- - -

- ^54. <http://www.gnome.org/projects/epiphany/> -

- - -

- ^55. <http://galeon.sourceforge.net/> -

- - -

- ^56. <http://elinks.or.cz/> -

- - -

- ^57. <http://links.twibright.com/> -

- - -

- ^58. <http://w3m.sourceforge.net/> -

- - -

- ^59. LaTeX and pdf features introduced 18^th June 2001, Landscape and portrait pdfs introduced 7^th October 2001., Lout is a more recent addition 22^th April 2003 -

- - -

- ^60. <http://www.adobe.com/products/acrobat/readstep2.html> -

- - -

- ^61. <http://www.gnome.org/projects/evince/> -

- - -

- ^62. <http://www.foolabs.com/xpdf/> -

- - -

- ^63. <http://www.postgresql.org/> -

- - -

- <http://advocacy.postgresql.org/> -

- - -

- <http://en.wikipedia.org/wiki/Postgresql> -

- - -

- ^64. <http://www.hwaci.com/sw/sqlite/> -

- - -

- <http://en.wikipedia.org/wiki/Sqlite> -

- - -

- ^65. Relational database features retaining document structure and citation introduced 15^th July 2002 -

- - -

- ^66. <http://search.sisudoc.org> -

- - -

- ^67. (which could be extended further with current back-end). As regards scaling of the database, it is as scalable as the database (here Postgresql) and hardware allow. -

- - -

- ^68. of this feature when demonstrated to an IBM software innovations evaluator in 2004 he said to paraphrase: this could be of interest to us. We have large document management systems, you can search hundreds of thousands of documents and we can tell you which documents meet your search criteria, but there is no way we can tell you without opening each document where within each your matches are found. -

- - -

- ^69. OCN are provided for HTML, XML, pdf ... though currently omitted in plain-text and opendocument format output -

- - -

- ^70. Concordance/ WordMaps introduced 15^th August 2002 -

- - -

- ^71. <http://www.vim.org/> -

- - - -

- -

- - - - - - - - - - - - - - - - - -

- -

- - - - - - -

- -

- - - - -

- -

- - - - - - - - -

- -
- - - - - -	- - - Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) - - - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. - - - SiSU - - is software for document structuring, publishing and search, - - - www.jus.uio.no/sisu - - and - - www.sisudoc.org - - - w3 since October 3 1993 - - ralph@amissah.com - - -	- - SiSU using: - Standard SiSU markup syntax, - Standard SiSU meta-markup syntax, and the - Standard SiSU object citation numbering and system, (object/text positioning system) - - Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. - -
- - - - - -	- - - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> - -	- - SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. - - Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. - - Get With the Future - - Way Better! - - -

- - - - - -

-
- - - -
- -
-

- - - - -

- -
-

- - - - -

- - -

- \ No newline at end of file diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/concordance.html b/data/doc/manuals_generated/sisu_manual/sisu_description/concordance.html deleted file mode 100644 index b82e2ea0..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/concordance.html +++ /dev/null @@ -1,2819 +0,0 @@ - - - - - SiSU created WordIndex for: SiSU - Description - - - - - - - - - - - - - - - - -

- -

- - - - - - - - - - - - - - -

- SiSU is a flexible document preparation, generation publishing and search system. ¹ -

- -

-

SiSU - Description
Ralph Amissah
- -

Word index links are to html versions of the text the segmented version followed by the scroll (single document) version.
[For segmented text references [T1], [T2] or [T3] appearing without a link, indicates that the word appears in a title (or subtitle) of the text (that is identifiable by the appended object citation number).]

(The word listing/index is Case sensitive: Capitalized words appear before lower case)

- word (number of occurences)
linked references to word within document
- [if number of occurences exceed number of references - word occurs more than once in at least one reference. Footnote/endnotes are either assigned to the paragraph from which they are referenced or ignored, so it is relevant to check the footnotes referenced from within a paragraph as well.] -

- (After the page is fully loaded) you can jump directly to a word by appending a hash (#) and the word to the url for this text, (do not forget that words are case sensitive, and may be listed twice (starting with and without an upper case letter)), #your_word # [ http://[web host]/sisu_description/concordance.html#your_word ] -

- -

Able

(3)

8, 57, 106,

About

(4)

57, 98, 107,

Above

(1)

228,

Abstraction

(2)

57,

Academic

(1)

23,

Acceptable

(2)

15, 65,

Accepted

(1)

31,

Accurate

(1)

23,

Accurately

(3)

97, 98, 176,

Across

(19)

8, 9, 15, 32, 33, 53, 84, 85, 91, 92, 94, 97, 98, 137, 158, 160, 176, 200, 231,

Actually

(2)

14, 22,

Add

(4)

14, 44, 193, 236,

Added

(3)

43, 44, 143,

Adding

(1)

36,

Addition

(7)

23, 34, 41, 81, 90, 99, 182,

Additional

(4)

68, 100, 187, 238,

Addressed

(1)

Addresses

(1)

14,

Adjustments

(1)

14,

Adobe

(1)

183,

Advance

(1)

35,

Advantage

(6)

15, 16, 31, 57, 59, 101,

Advantages

(2)

19, 141,

Again

(1)

215,

Against

(3)

44, 50, 57,

Age

(1)

Aini

(1)

14,

Alias

(1)

14,

All

(34)

11, 16, 20, 33, 35, 36, 40, 59, 66, 68, 91, 92, 94, 96, 97, 98, 102, 103, 113, 187, 188, 190, 194, 195, 196, 200,

Allow

(3)

8, 187, 199,

Almost

(3)

11, 28, 190,

Along

(3)

14, 190, 213,

Alphabetical

(1)

222,

Already

(2)

228, 237,

Also

(17)

6, 14, 23, 29, 30, 31, 33, 98, 133, 148, 149, 168, 178, 182, 216, 231,

Alternative

(3)

44, 100, 187,

Alternatively

(1)

215,

Alternatives

(1)

22,

Always

(1)

118,

Amissah

(1)

[H]1,

Amongst

(4)

31, 104, 228, 235,

Amount

(1)

65,

Amounts

(1)

61,

Anagram

(1)

14,

And

(225)

5, 6, 7, 8, 9, 11, 13, 14, 15, 16, 17, 18, 22, 23, 25, 28, 29, 30, 31, 32, 33, 35, 36, 37, 42, 43, 44, 45, 49, 50, 51, 52, 53, 54, 55, 57, 59, 65, 66, 68, 81, 82, 83, 84, 85, 88, 90, 91, 92, 93, 96, 97, 98, 99, 103, 106, 107, 108, 110, 121, 125, 130, 131, 134, 136, 139, 140, 143, 145, 149, 151, 153, 156, 172, 176, 178, 181, 182, 186, 187, 189, 190, 191, 192, 194, 195, 196, 198, 199, 200, 201, 213, 214, 216, 217, 218, 222, 226, 227, 228, 229, 230, 231, 235, 238,

Another

(5)

16, 44, 59, 190,

Any

(7)

8, 11, 57, 149, 187, 214, 215,

Appear

(1)

64,

Appearance

(3)

39, 90, 238,

Appeared

(1)

15,

Appears

(2)

93, 196,

Application

(1)

136,

Applied

(1)

April

(1)

182,

Arbitration

(1)

112,

Are

(78)

5, 7, 8, 14, 15, 20, 28, 33, 34, 41, 43, 44, 55, 57, 65, 68, 84, 85, 90, 96, 98, 99, 113, 114, 121, 122, 133, 134, 137, 145, 147, 148, 151, 152, 154, 159, 178, 182, 188, 191, 200, 207, 213, 214, 215, 220, 230, 234, 235,

Article

(1)

238,

Articles

(1)

151,

Ascii

(4)

65, 77, 192,

ASCIIs

(1)

65,

Assigned

(2)

57, 99,

Associate

(1)

111,

Associated

(3)

50, 117, 136,

Association

(3)

110, 121,

Associations

(3)

35, 110, 114,

Assuming

(1)

125,

Attachments

(1)

50,

Attempt

(1)

[H]2,

Attractive

(1)

98,

Attributes

(1)

30,

August

(1)

222,

Author

(3)

14, 189, 238,

Authored

(1)

57,

Authors

(1)

98,

Auto

(3)

121, 129,

Automated

(2)

92, 98,

Automatic

(1)

133,

Automatically

(7)

50, 98, 130, 132, 187,

Autonomous

(2)

147, 151,

Available

(20)

9, 15, 23, 34, 48, 65, 66, 68, 84, 85, 92, 103, 108, 118, 126, 154, 195, 196, 216,

Away

(2)

14,

Back

(3)

14, 191, 199,

Backed

(1)

46,

Backend

(1)

198,

Background

(1)

136,

Backup

(2)

229, 232,

Base

(1)

232,

Based

(18)

8, 16, 37, 57, 59, 92, 106, 128, 141, 143, 144, 153, 155, 157, 222,

Basic

(10)

11, 29, 30, 51, 62, 63, 64, 96, 238,

Basis

(3)

14, 99, 136,

Batch

(4)

12, 41, 225, 226,

Because

(3)

14, 195,

Become

(1)

33,

Been

(15)

8, 14, 15, 22, 54, 65, 99, 157, 197, 228, 238,

Behaviour

(1)

104,

Being

(11)

55, 81, 93, 94, 96, 111, 152, 182, 190, 194,

Believe

(1)

14,

Belong

(2)

96, 98,

Below

(3)

8, 21, 145,

Benefit

(1)

Best

(4)

9, 16, 55, 59,

Better

(1)

187,

Beyond

(2)

14, 30,

Bit

(2)

14, 35,

Blocks

(1)

92,

Body

(1)

125,

Bold

(4)

30, 83, 85,

Book

(4)

9, 16, 59, 238,

Booleans

(1)

201,

Born

(1)

15,

Both

(10)

14, 57, 98, 107, 108, 190, 191, 231,

Bottom

(2)

149,

Break

(2)

16, 59,

Breaks

(2)

16, 59,

Broken

(1)

194,

Browser

(2)

93, 97,

Browsers

(5)

158, 159, 160, 168, 176,

Browsing

(2)

172, 222,

Bug

(1)

104,

Build

(2)

68, 122,

Building

(2)

23, 42,

Builds

(1)

224,

Built

(1)

235,

Bundled

(1)

50,

But

(15)

7, 14, 16, 41, 53, 55, 57, 59, 97, 157, 213, 222,

Called

(4)

9, 50, 98, 122,

Calls

(1)

14,

Can

(30)

7, 8, 11, 14, 16, 32, 44, 59, 95, 100, 113, 130, 132, 188, 196, 200, 213, 231,

Canned

(2)

202, 216,

Cares

(1)

143,

Cascading

(1)

153,

Case

(5)

13, 16, 59, 141, 207,

Cases

(5)

11, 16, 40, 59, 85,

Certain

(2)

104, 125,

Certificates

(1)

31,

Certification

(2)

37, 57,

Change

(3)

93, 96,

Changed

(4)

7, 39, 93, 104,

Changes

(4)

22, 90, 231,

Chapter

(3)

16, 59, 149,

Chapters

(4)

16, 59, 141, 151,

Characters

(2)

16, 59,

Check

(2)

37, 83,

Checks

(1)

37,

Cheek

(1)

14,

Choice

(1)

234,

Choose

(2)

98, 188,

Chose

(1)

49,

(1)

(1)

(1)

(2)

147, 151,

Citation

(29)

6, 9, 20, 23, 32, 91, 92, 95, 97, 98, 99, 100, 104, 142, 186, 187, 194, 195, 196, 198, 199, 200, 214,

Cite

(2)

8, 88,

Citeable

(1)

93,

Citing

(2)

92, 124,

Cition

(1)

92,

Claim

(2)

92, 96,

Classification

(1)

107,

Clean

(3)

77, 190, 191,

Clearly

(2)

35, 195,

Code

(7)

89, 90, 157, 231,

Combination

(2)

57, 196,

Comes

(1)

14,

Command

(1)

Comment

(2)

99,

Common

(8)

6, 7, 8, 20, 32, 94, 98, 142,

Comparison

(1)

37,

Complex

(1)

196,

Composite

(1)

42,

Comprising

(1)

57,

Computer

(1)

107,

Concept

(2)

14, 55,

Concordance

(7)

31, 36, 57, 80, 221, 222,

Configuration

(3)

110, 235,

Confined

(1)

149,

Consider

(1)

216,

Considerable

(4)

23, 43, 44, 57,

Considerably

(1)

66,

Considerations

(1)

37,

Consisting

(1)

36,

Consists

(1)

57,

Console

(1)

172,

Constant

(1)

22,

Constituent

(4)

16, 59, 141, 194,

Construct

(1)

194,

Constructing

(1)

23,

Construction

(1)

23,

Contain

(3)

30, 100, 104,

Contained

(1)

Containing

(2)

189, 191,

Contains

(1)

192,

Content

(17)

7, 23, 31, 32, 37, 38, 41, 57, 89, 90, 196, 222,

Contents

(4)

85, 127, 128, 196,

Contract

(3)

147, 151,

Control

(12)

16, 37, 59, 123, 125, 141, 229, 230, 231,

Controlled

(1)

39,

Convenient

(2)

15, 23,

Convention

(2)

63, 70,

Conversion

(4)

16, 59, 65, 141,

Convert

(1)

51,

Converted

(3)

15, 22, 29,

Converters

(1)

228,

(4)

92, 96, 206, 212,

Core

(6)

14, 30, 105, 106, 189, 196,

Corrected

(1)

104,

Correctly

(1)

201,

Could

(9)

16, 22, 59, 90, 187, 199, 213, 216, 238,

Counter

(1)

133,

Counters

(1)

216,

Couple

(1)

114,

Courage

(1)

14,

Course

(2)

51, 193,

Cover

(1)

54,

Covers

(1)

51,

Create

(3)

14, 57, 216,

Created

(5)

16, 59, 111, 113, 195,

Creates

(1)

35,

Creation

(2)

42, 113,

Criteria

(4)

7, 213,

Cross

(3)

131, 134, 191,

Css

(6)

8, 68, 143, 144, 155, 176,

Current

(3)

15, 154, 199,

Currently

(10)

8, 13, 31, 45, 182, 186, 188, 198, 214,

CVS

(4)

37, 125, 230, 231,

Darcs

(1)

231,

Data

(4)

8, 90, 188,

Database

(38)

7, 8, 13, 14, 20, 22, 23, 32, 33, 35, 45, 51, 97, 103, 104, 186, 187, 188, 194, 195, 196, 198, 199, 200, 216, 223, 228,

Databases

(7)

9, 31, 33, 113, 143, 187,

Dates

(1)

Dealing

(1)

12,

Debian

(3)

15, 203, 209,

Deeper

(1)

178,

Default

(9)

14, 37, 117, 118, 119, 122, 132, 136, 137,

Define

(1)

40,

Defined

(3)

35, 121, 195,

Defines

(1)

30,

Definition

(1)

14,

Degree

(4)

7, 33, 43, 44,

Deliberately

(1)

85,

Demonstrated

(1)

213,

Demonstrates

(1)

199,

Dependency

(1)

51,

Dependent

(2)

13, 45,

Depending

(3)

97, 98, 151,

Describe

(1)

[H]2,

Described

(5)

8, 14, 98, 145, 220,

Description

(6)

[H]1, 3, 30, 105, 106, 228,

Descriptive

(2)

14,

Deserves

(1)

14,

Design

(5)

65, 236, 238,

Designed

(2)

87, 88,

Desired

(8)

41, 42, 50, 81, 90, 121, 141, 220,

Detail

(1)

100,

Determine

(3)

16, 35, 59,

Determined

(2)

65, 96,

Determining

(1)

111,

Develop

(1)

22,

Developed

(3)

5, 53, 54,

Developers

(1)

52,

Development

(3)

5, 8, 197,

Diakonos

(1)

235,

Different

(15)

9, 16, 19, 31, 49, 57, 59, 85, 93, 97, 136, 140, 141,

Difficulty

(1)

136,

Diffing

(1)

38,

Digests

(1)

31,

Digital

(1)

32,

Dillo

(1)

169,

Directed

(1)

14,

Directories

(3)

113, 114, 224,

- SiSU - Description,
Ralph Amissah -

- -

- SiSU an attempt to describe -

- -

- 1. Description -

- -

- 1.1 Outline -

- -

- 1.2 Short summary of features -

- -

- 1.3 How it works -

- -

- 1.4 Simple markup -

- -

- 1.4.1 Sparse markup requirement, try to get the most out of markup -

- -

- 1.4.2 Single markup file provides multiple output formats -

- -

- 1.4.3 Syntax relatively easy to read and remember -

- -

- 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types -

- -

- 1.5 Designed with usability in mind -

- -

- 1.6 Code separate from content -

- -

- 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine -

- -

- 1.8 Handling of Dublin Core meta-tags making use of the Resource Description Framework -

- -

- 1.9 Easy directory management -

- -

- 1.10 Document Version Control Information -

- -

- 1.11 Table of contents -

- -

- 1.12 Auto-numbering of headings -

- -

- 1.13 Numbering and cross-hyperlinking of endnotes -

- -

- 1.14 "Skinnable" -

- -

- 1.15 Multiple Outputs -

- -

- 1.15.1 html - several presentations: full length & segmented; css & table based -

- -

- 1.15.2 XML -

- -

- 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 -

- -

- 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) -

- -

- 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) -

- -

- 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) -

- -

- 1.15.7 Other forms -

- -

- 1.16 Concordance / Word Map or rudimentary index -

- -

- 1.17 Managed (document) directory, database, or site structure -

- -

- 1.18 Batch processing -

- -

- 1.19 Integration to superior Gnu/Linux and Unix tools -

- -

- 1.19.1 Backup and version control -

- -

- 1.19.2 Editor support -

- -

- 1.20 Modular design, need something new add a module -

- -

- - - Document Information (metadata) - - - - - -

- - SiSU - Description,
Ralph Amissah -

- 1 -

- - - - -

- - SiSU an attempt to describe -

- 2 -

- - - - -

- - 1. Description -

- 3 -

- - - - -

- - 1.1 Outline -

- 4 -

- - - - -

- 5 -

- - - - -

- 6 -

- - - - -

- 7 -

- - - - -

- 8 -

- - - - -

- 9 -

- - - - -

- (ii) Markup is done once for the multiple formats produced. -

- 10 -

- - - - -

- 11 -

- - - - -

- (iv) SiSU is a batch processor, dealing with as many files as you need to generate at a time. -

- 12 -

- - - - -

- (v) Scalability is dependent on your file system (in my case Reiserfs), the database (currently Postgresql and/or SQLite) and your hardware. -

- 13 -

- - - - -

- 14 -

- - - - -

- 15 -

- - - - -

- 16 -

- - - - -

- From markup that is simpler and more sparse than html you get: -

- 17 -

- - - - -

- far greater output possibilities, including html, XML, ODF (OpenDocument), LaTeX (pdf), and SQL; -

- 18 -

- - - - -

- the advantages implicit in the very different output possibilities; -

- 19 -

- - - - -

- a common citation system (for all outputs - including the relational database, search results are relevant for all outputs); -

- 20 -

- - - - -

- For more see the short summary of features provided below. -

- 21 -

- - - - -

- 22 -

- - - - -

- 23 -

- - - - -

- - 1.2 Short summary of features -

- 24 -

- - - - -

- (i) markup syntax: (a) simpler than html, (b) mnemonic, influenced by mail/messaging/wiki markup practices, (c) human readable, and easily writable, -

- 25 -

- - - - -

- (ii) (a) minimal markup requirement, (b) single file marked up for multiple outputs, -

- 26 -

- - - - -

- notes: -

- 27 -

- - - - -

- 28 -

- - - - -

- 29 -

- - - - -

- 30 -

- - - - -

- 31 -

- - - - -

- 32 -

- - - - -

- 33 -

- - - - -

- (vi) use of semantic meta-tags in headers permit the addition of semantic information on documents, (the available fields are easily extended) -

- 34 -

- - - - -

- 35 -

- - - - -

- (viii) "Concordance file" wordmap, consisting of all the words in a document and their (text/ object) locations within the text, (and the possibility of adding vocabularies), -

- 36 -

- - - - -

- 37 -

- - - - -

- (x) SiSU's minimalist markup makes for meaningful "diffing" of the substantive content of markup-files, -

- 38 -

- - - - -

- (xi) easily skinnable, document appearance on a project/site wide, directory wide, or document instance level easily controlled/changed, -

- 39 -

- - - - -

- 40 -

- - - - -

- 41 -

- - - - -

- 42 -

- - - - -

- there is a considerable degree of future-proofing, output representations are "upgradeable", and new document formats may be added. -

- 43 -

- - - - -

- 44 -

- - - - -

- (xvi) scalability, dependent on your file-system (ext3, Reiserfs, XFS, whatever) and on the relational database used (currently Postgresql and SQLite), and your hardware, -

- 45 -

- - - - -

- (xvii) only marked up files need be backed up, to secure the larger document set produced, -

- 46 -

- - - - -

- (xviii) document management, -

- 47 -

- - - - -

- (xix) Syntax highlighting for SiSU markup is available for a number of text editors. -

- 48 -

- - - - -

- 49 -

- - - - -

- 50 -

- - - - -

- 51 -

- - - - -

- as a developers tool it is flexible and extensible -

- 52 -

- - - - -

- 53 -

- - - - -

- SiSU has been developed and has been in use for several years. Requirements to cover a wide range of documents within its use domain have been explored. -

- 54 -

- - - - -

- 55 -

- - - - -

- - 1.3 How it works -

- 56 -

- - - - -

- 57 -

- - - - -

- - 1.4 Simple markup -

- 58 -

- - - - -

- SiSU markup is based on requiring the minimum markup needed to determine the structure of a document. (This can be as little as saying in a header to look for the word Book at a specified level and the word Chapter at another level). SiSU then breaks a document into its smallest parts (at a heading, and paragraph level) while retaining all structural information. This break up of the document and information on its structure is taken advantage of in the transformations made in generating the very different output types that can be created, and in providing as much as can be for what each output type is best at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), ODF (OpenDocument), SQL (e.g. document search; representing constituent parts of documents based on their structure, headings, chapters, paragraphs as required; user control). ¹⁷ -

- 59 -

- - - - -

- - 1.4.1 Sparse markup requirement, try to get the most out of markup -

- 60 -

- - - - -

- One of its strengths is that very small amounts of initial tagging is required for the program to generate its output. -

- 61 -

- - - - -

- This is a basic markup example: -

- 62 -

- - - - -

- basic markup example, text file - an international convention ¹⁸ -

- 63 -

- - - - -

- view basic markup, as it would be highlighted by vim editor ¹⁹ -

- 64 -

- - - - -

- 65 -

- - - - -

- 66 -

- - - - -

- - 1.4.2 Single markup file provides multiple output formats -

- 67 -

- - - - -

- For each document, there is only one (input, minimalistically marked up) file from which all the available output types are generated. ²¹ -

- 68 -

- - - - -

- Eg. the markup example: -

- 69 -

- - - - -

- original text file - an international convention ²² -

- 70 -

- - - - -

- view as syntax would be highlighted by vim editor ²³ -

- 71 -

- - - - -

- Produces the following output: -

- 72 -

- - - - -

- Segmented html version of document ²⁴ -

- 73 -

- - - - -

- Full length html document ²⁵ -

- 74 -

- - - - -

- pdf landscape version of document ²⁶ -

- 75 -

- - - - -

- pdf portrait version of document ²⁷ -

- 76 -

- - - - -

- clean tex ascii version of document ²⁸ -

- 77 -

- - - - -

- xml sax version of document ²⁹ -

- 78 -

- - - - -

- xml dom version of document ³⁰ -

- 79 -

- - - - -

- Concordance ³¹ -

- 80 -

- - - - -

- (and in addition to these: PostgreSQL, SQLite, texinfo and ~~YAML~~ ³² versions if desired) -

- 81 -

- - - - -

- - 1.4.3 Syntax relatively easy to read and remember -

- 82 -

- - - - -

- Syntax is kept simple and mnemonic. ³³ -

- 83 -

- - - - -

- - 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types -

- 84 -

- - - - -

- 85 -

- - - - -

- The publishing feature set may be expanded as required. -

- 86 -

- - - - -

- - 1.5 Designed with usability in mind -

- 87 -

- - - - -

- Output is designed to be uniform, easy to read, navigate and cite. -

- 88 -

- - - - -

- - 1.6 Code separate from content -

- 89 -

- - - - -

- 90 -

- - - - -

- - 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine -

- 91 -

- - - - -

- 92 -

- - - - -

- in html, html not being easily citeable (change font size, or use a different browser and the page on which specific text appears has changed), and -

- 93 -

- - - - -

- across multiple formats being common to all output formats html/xml/pdf/sql output, -

- 94 -

- - - - -

- the results of an sql search can just be "live" citation references to the documents in which the text is found, much like an index (see image examples provided). ³⁵ -

- 95 -

- - - - -

- 96 -

- - - - -

- 97 -

- - - - -

- 98 -

- - - - -

- 99 -

- - - - -

- 100 -

- - - - -

- An advantage is that the numbering remains the same regardless of document structure. -

- 101 -

- - - - -

- Text object ("paragraph") numbering is the same for all output versions of the same document, vis html, pdf, pgsql, yaml etc. -

- 102 -

- - - - -

- 103 -

- - - - -

- 104 -

- - - - -

- - 1.8 Handling of Dublin Core meta-tags making use of the Resource Description Framework -

- 105 -

- - - - -

- SiSU is able to use meta tags based on the Dublin Core ³⁶ and Resource Description Framework ³⁷ -

- 106 -

- - - - -

- 107 -

- - - - -

- 108 -

- - - - -

- - 1.9 Easy directory management -

- 109 -

- - - - -

- 1. Directory file association, skins and special image management, made simpler. ³⁸ -

- 110 -

- - - - -

- 111 -

- - - - -

- -  /www/docs
-      /intellectual_property
-      /arbitration
-      /contract_law

-  /www/docs
-      /ralph
-      /sisu - -

- 112 -

- - - - -

- all are placed in their own directories within the directory structure created. Similar rules are used in the creation of sql type databases (though they can be overridden). -

- 113 -

- - - - -

- There are a couple of further associations with these directories. -

- 114 -

- - - - -

- Directory wide skins. -

- 115 -

- - - - -

- Directory specific images. -

- 116 -

- - - - -

- 117 -

- - - - -

- a. default skin (always available) -

- 118 -

- - - - -

- b. directory skin (precedence over default if exists) -

- 119 -

- - - - -

- c. document skin (takes precedence wherever document requests a specific skin) -

- 120 -

- - - - -

- 121 -

- - - - -

- 3. If the working directory has within it a sub-directory called image_local, the images within that directory are used for references to images, that are not part of the default site build. -

- 122 -

- - - - -

- - 1.10 Document Version Control Information -

- 123 -

- - - - -

- The possibility of citing an exact document version. -

- 124 -

- - - - -

- 125 -

- - - - -

- 126 -

- - - - -

- - 1.11 Table of contents -

- 127 -

- - - - -

- SiSU produces a rudimentary a table of contents based on document headings. -

- 128 -

- - - - -

- - 1.12 Auto-numbering of headings -

- 129 -

- - - - -

- Headings can be automatically numbered, (and automatically named for hyper-linking) -

- 130 -

- - - - -

- - 1.13 Numbering and cross-hyperlinking of endnotes -

- 131 -

- - - - -

- SiSU can automatically number footnotes/endnotes. This is the default operation where no number is provided. -

- 132 -

- - - - -

- Footnotes/endnotes may also be manually numbered. Where a number, or numbers are provided for a footnote/endnote, this does not increment the automatic footnote/endnote number counter. -

- 133 -

- - - - -

- In the html output footnotes/endnotes are cross-hyper-linked (to their reference point and vice versa). In th pdf output footnotes are linked from their reference point only. -

- 134 -

- - - - -

- - 1.14 "Skinnable" -

- 135 -

- - - - -

- 136 -

- - - - -

- Whilst it is skinnable, the default output styles are selected to work across the widest possible range of document types. -

- 137 -

- - - - -

- - 1.15 Multiple Outputs -

- 138 -

- - - - -

- From markup that is simpler and more sparse than html you get: -

- 139 -

- - - - -

- far greater output possibilities, including multiple html types, XML (different structured types), LaTeX (pdf landscape, portrait), and SQL (Postgresql or SQLite or other); -

- 140 -

- - - - -

- the advantages implicit in these very different output possibilities; ⁴¹ -

- 141 -

- - - - -

- a common citation system -

- 142 -

- - - - -

- 143 -

- - - - -

- - 1.15.1 html - several presentations: full length & segmented; css & table based -

- 144 -

- - - - -

- Most documents are produced in single and segmented html versions, described below: -

- 145 -

- - - - -

- The Scroll (full length text presentations) -

- 146 -

- - - - -

- The full length of the text in a single scrollable document. ⁴² As a rule the files they are saved in are named: doc or more precisely doc.html -

- 147 -

- - - - -

- For various reasons texts may only be provided in this form (such as this one which is short), though most are also provided as segmented texts. -

- 148 -

- - - - -

- "Scroll" is a reference to the historical scroll, a single long document/ parchment, and also no doubt to what you will have to do to get to the bottom of the text. ⁴³ -

- 149 -

- - - - -

- The Segmented Text -

- 150 -

- - - - -

- 151 -

- - - - -

- 152 -

- - - - -

- Cascading Style Sheet, and Table based html -

- 153 -

- - - - -

- SiSU outputs html, two current standard forms available are: -

- 154 -

- - - - -

- css based -

- 155 -

- - - - -

- and -

- 156 -

- - - - -

- table based [largely discontinued ] ⁴⁵ -

- 157 -

- - - - -

- The html is tested across several browsers -

- 158 -

- - - - -

- I like to remind you that there are other excellent browsers out there, many of which have long supported practical features like tabbing. -

- 159 -

- - - - -

- The html is tested across several browsers, including: -

- 160 -

- - - - -

- Firefox (Mozilla-Firefox) ⁴⁶ -

- 161 -

- - - - -

- Kazehakase ⁴⁷ -

- 162 -

- - - - -

- Konqueror ⁴⁸ -

- 163 -

- - - - -

- Mozilla ⁴⁹ -

- 164 -

- - - - -

- MS Internet Explorer ⁵⁰ -

- 165 -

- - - - -

- Netscape ⁵¹ -

- 166 -

- - - - -

- Opera ⁵² -

- 167 -

- - - - -

- Also lighter weight graphical browsers: -

- 168 -

- - - - -

- Dillo ⁵³ -

- 169 -

- - - - -

- Epiphany ⁵⁴ -

- 170 -

- - - - -

- Galeon ⁵⁵ -

- 171 -

- - - - -

- And for console/text browsing: -

- 172 -

- - - - -

- elinks ⁵⁶ -

- 173 -

- - - - -

- links2 ⁵⁷ -

- 174 -

- - - - -

- w3m ⁵⁸ -

- 175 -

- - - - -

- The html tables output is rendered more accurately across a wider variety set and older versions of browsers (than the html css output). -

- 176 -

- - - - -

- - 1.15.2 XML -

- 177 -

- - - - -

- 178 -

- - - - -

- - 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 -

- 179 -

- - - - -

- SiSU generates Open Document Output format. -

- 180 -

- - - - -

- - 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) -

- 181 -

- - - - -

- 182 -

- - - - -

- Adobe Reader ⁶⁰ -

- 183 -

- - - - -

- Evince ⁶¹ -

- 184 -

- - - - -

- xpdf ⁶² -

- 185 -

- - - - -

- - 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) -

- 186 -

- - - - -

- 187 -

- - - - -

- 188 -

- - - - -

- one containing semantic (and other) headers, including, title, author, subject, (the Dublin Core...); -

- 189 -

- - - - -

- 190 -

- - - - -

- a third containing endnotes cross-referenced back to the paragraph from which they are referenced (both in formatted and clean text versions for searching). -

- 191 -

- - - - -

- a fourth table with a one to one relation with the headers table contains full text versions of output, eg. pdf, html, xml, and ascii. -

- 192 -

- - - - -

- There is of course the possibility to add further structures. -

- 193 -

- - - - -

- 194 -

- - - - -

- 195 -

- - - - -

- 196 -

- - - - -

- This is a larger scale project, (with little development on the front end largely ignored), though the "infrastructure" has been in place since 2002. -

- 197 -

- - - - -

- - 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) -

- 198 -

- - - - -

- Sample search frontend ⁶⁶ A small database and sample query front-end (search from) that makes use of the citation system, object citation numbering to demonstrates functionality. ⁶⁷ -

- 199 -

- - - - -

- 200 -

- - - - -

- (further work needs to be done on the sample search form, which is rudimentary and only passes simple booleans correctly at present to the SQL engine) -

- 201 -

- - - - -

- A few canned searches, showing object numbers. Search for: -

- 202 -

- - - - -

- 203 -

- - - - -

- 204 -

- - - - -

- 205 -

- - - - -

- Note that the searches done in this form are case sensitive. -

- 206 -

- - - - -

- 207 -

- - - - -

- Expand those same searches, showing the matching text in each document: -

- 208 -

- - - - -

- 209 -

- - - - -

- 210 -

- - - - -

- 211 -

- - - - -

- Paragraph mode, you may alternatively display the text of each paragraph in which the match was made, again the object/paragraph numbers are relevant to any SiSU generated/published text. -

- 212 -

- - - - -

- 213 -

- - - - -

- 214 -

- - - - -

- 215 -

- - - - -

- 216 -

- - - - -

- Earlier version of the search frontend - Simple search, results with files in which search found, and locations where found within files. -

- 217 -

- - - - -

- Simple search, results with files in which search found, and text object (paragraph or endnote) where found within files. -

- 218 -

- - - - -

- - 1.15.7 Other forms -

- 219 -

- - - - -

- 220 -

- - - - -

- - 1.16 Concordance / Word Map or rudimentary index -

- 221 -

- - - - -

- 222 -

- - - - -

- - 1.17 Managed (document) directory, database, or site structure -

- 223 -

- - - - -

- 224 -

- - - - -

- - 1.18 Batch processing -

- 225 -

- - - - -

- SiSU is a batch processing tool, handling and transforming multiple (or individual) documents (in many ways) with a single instruction. -

- 226 -

- - - - -

- - 1.19 Integration to superior Gnu/Linux and Unix tools -

- 227 -

- - - - -

- 228 -

- - - - -

- - 1.19.1 Backup and version control -

- 229 -

- - - - -

- Unix provides many tools for version control. For documents Subversion, CVS and even the old RCS are useful for the per-document histories they provide. -

- 230 -

- - - - -

- 231 -

- - - - -

- Several backup tools exist. At the base level I tend to use rdiff. -

- 232 -

- - - - -

- - 1.19.2 Editor support -

- 233 -

- - - - -

- SiSU documents are prepared / marked up in utf-8 text you are free to use the text editor of your choice. -

- 234 -

- - - - -

- 235 -

- - - - -

- - 1.20 Modular design, need something new add a module -

- 236 -

- - - - -

- Need a new output format that does not already exist, write a new module. -

- 237 -

- - - - -

- 238 -

- - - - -

- - Endnotes -

- 0 -

- - - -

- -

- - - - -

- -

- - - - -

- ^2. also chosen for the meaning of the Finnish term "sisu". -

- -

- - - - -

- ^3. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- -

- - - - -

- ^4. pdf via LaTeX or lout -

- -

- - - - -

- ^5. currently html (two forms of html presentation one based on css the other on tables), and PHP; potentially structured XML -

- -

- - - - -

- ^6. any SQL - currently PostgreSQL and sqlite (for portability, testing and development) -

- -

- - - - -

- ^7. previously called "text object numbering" -

- -

- - - - -

- -

- - - - -

- -

- - - - -

- ^10. "Sisu refers not to the courage of optimism, but to a concept of life that says, 'I may not win, but I will gladly give my life for what I believe.'" Aini Rajanen, Of Finnish Ways, 1981, p. 10.
<http://www.humanlanguages.com/finnishenglish/rlfs.htm>
"Every Finn has his own pet definition. To me, sisu means patience without passion. But there are many varieties of sisu. Sisu can be a sudden outburst or it can be the kind that lasts. A man can have both kinds. It is outside reason. It is something in the soul. It comes from oneself. For instance, it makes a soldier do things because he himself must, not because he has been told." Paavo Nurmi
<http://personalweb.smcvt.edu/tmatikainen/finnishtraditions.htm> -

- -

- - - - -

- ^11. <http://www.perl.org/> -

- -

- - - - -

- ^12. <http://www.ruby-lang.org/en/> -

- -

- - - - -

- ^13. <http://www.debian.org/> -

- -

- - - - -

- -

- - - - -

- -

- - - - -

- ^16. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- -

- - - - -

- -

- - - - -

- ^18. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> output provided as example in the next section -

- -

- - - - -

- ^19. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> as it would appear with syntax highlighting (by vim) -

- -

- - - - -

- ^20. seems there are several "smart ASCIIs" available, primarily for ascii to html conversion, that make this, and reasonable looking ascii their goal
<http://webseitz.fluxent.com/wiki/SmartAscii>
<http://daringfireball.net/projects/markdown/>
<http://www.textism.com/tools/textile/> -

- -

- - - - -

- -

- - - - -

- ^22. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> -

- -

- - - - -

- ^23. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> -

- -

- - - - -

- ^24. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/toc.html> -

- -

- - - - -

- ^25. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/doc.html> -

- -

- - - - -

- ^26. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/landscape.pdf> -

- -

- - - - -

- ^27. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/portrait.pdf> -

- -

- - - - -

- ^28. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/plain.txt> -

- -

- - - - -

- ^29. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/sax.xml> -

- -

- - - - -

- ^30. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/dom.xml> -

- -

- - - - -

- ^31. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/concordance.html> -

- -

- - - - -

- ^32. discontinued for the time being -

- -

- - - - -

- ^33. SiSU markup syntax, an incomplete summary: <http://www.jus.uio.no/sisu/sisu_markup_table/doc.html#h200306>
Visual check of elementary font face modifiers: bold bold emphasis italics underscore ~~strikethrough~~ ^superscript _subscript -

- -

- - - - -

- ^34. the program that generates the documents -

- -

- - - - -

- ^35. <http://www.jus.uio.no/sisu/SiSU/1.html#search> -

- -

- - - - -

- ^36. <http://dublincore.org/> -

- -

- - - - -

- ^37. <http://www.w3.org/RDF/> -

- -

- - - - -

- ^38. The previous way was directory associations for file output were set up in the configuration file. The present system is a more natural way to work requireing less configuration. -

- -

- - - - -

- ^39. from a version control system such as CVS -

- -

- - - - -

- ^40. The version control system must be run, so the version number is obtained, prior to the SiSU document generation, and subsequent posting of the document. -

- -

- - - - -

- -

- - - - -

- ^42. CISG <http://www.jus.uio.no/lm/un_contracts_international_sale_of_goods_convention_1980/doc>
The Unidroit Contract Principles <http://www.jus.uio.no/lm/unidroit.contract.principles.1994/doc> or
The Autonomous Contract <http://www.jus.uio.no/lm/autonomous.contract.2000.amissah/doc> -

- -

- - - - -

- ^43. Scrolling is not however necessarily confined to full length documents as you will have to scroll to get to the bottom of any long segment (eg. chapter) of a segmented text. -

- -

- - - - -

- ^44. CISG <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980>
The Unidroit Principles <http://www.jus.uio.no/lm/unidroit.contract.principles.1994>
The Autonomous Contract <http://www.jus.uio.no/sisu/the.autonomous.contract.2000.amissah> or
WTA 1994 <http://www.jus.uio.no/lm/wta.1994> -

- -

- - - - -

- ^45. formatting possibility still exists in code tree but maintenance has been largely discontinuted. -

- -

- - - - -

- ^46. <http://www.mozilla.org/products/firefox/> -

- -

- - - - -

- ^47. <http://kazehakase.sourceforge.jp/> -

- -

- - - - -

- ^48. <http://www.konqueror.org/> -

- -

- - - - -

- ^49. <http://www.mozilla.org/> -

- -

- - - - -

- ^50. <http://www.microsoft.com/windows/ie/default.asp> -

- -

- - - - -

- ^51. <http://home.netscape.com/comprod/mirror/client_download.html> -

- -

- - - - -

- ^52. <http://www.opera.com/> -

- -

- - - - -

- ^53. <http://www.dillo.org/> -

- -

- - - - -

- ^54. <http://www.gnome.org/projects/epiphany/> -

- -

- - - - -

- ^55. <http://galeon.sourceforge.net/> -

- -

- - - - -

- ^56. <http://elinks.or.cz/> -

- -

- - - - -

- ^57. <http://links.twibright.com/> -

- -

- - - - -

- ^58. <http://w3m.sourceforge.net/> -

- -

- - - - -

- ^59. LaTeX and pdf features introduced 18^th June 2001, Landscape and portrait pdfs introduced 7^th October 2001., Lout is a more recent addition 22^th April 2003 -

- -

- - - - -

- ^60. <http://www.adobe.com/products/acrobat/readstep2.html> -

- -

- - - - -

- ^61. <http://www.gnome.org/projects/evince/> -

- -

- - - - -

- ^62. <http://www.foolabs.com/xpdf/> -

- -

- - - - -

- ^63. <http://www.postgresql.org/>
<http://advocacy.postgresql.org/>
<http://en.wikipedia.org/wiki/Postgresql> -

- -

- - - - -

- ^64. <http://www.hwaci.com/sw/sqlite/>
<http://en.wikipedia.org/wiki/Sqlite> -

- -

- - - - -

- ^65. Relational database features retaining document structure and citation introduced 15^th July 2002 -

- -

- - - - -

- ^66. <http://search.sisudoc.org> -

- -

- - - - -

- ^67. (which could be extended further with current back-end). As regards scaling of the database, it is as scalable as the database (here Postgresql) and hardware allow. -

- -

- - - - -

- -

- - - - -

- ^69. OCN are provided for HTML, XML, pdf ... though currently omitted in plain-text and opendocument format output -

- -

- - - - -

- ^70. Concordance/ WordMaps introduced 15^th August 2002 -

- -

- - - - -

- ^71. <http://www.vim.org/> -

- -

- - - - -

- - Document Information (metadata) -

- 0 -

- -

- Metadata -

- - - - - - - - -

- <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sisu_manifest.html> -

- - - -

- Dublin Core (DC) -

- - - -

- DC tags included with this document are provided here. -

- - - -

- DC Title: SiSU - Description -

- - - -

- DC Creator: Ralph Amissah -

- - - -

- DC Rights: Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 -

- - - -

- DC Type: information -

- - - -

- DC Date created: 2002-11-12 -

- - - -

- DC Date issued: 2002-11-12 -

- - - -

- DC Date available: 2002-11-12 -

- - - -

- DC Date modified: 2007-08-30 -

- - - -

- DC Date: 2007-08-30 -

- - - -

- Version Information -

- - - -

- Sourcefile: sisu_description.sst -

- - - -

- Filetype: SiSU text 0.57 -

- - - -

- Sourcefile Digest, MD5(sisu_description.sst)= b89ccdad9f6d9c2260d8d383d6b35ccc -

- - - -

- Skin_Digest: MD5(/home/ralph/grotto/theatre/dbld/builds/sisu/sisu/data/doc/sisu/sisu_markup_samples/sisu_manual/_sisu/skin/doc/skin_sisu_manual.rb)= 20fc43cf3eb6590bc3399a1aef65c5a9 -

- - - -

- Generated -

- - - -

- Document (metaverse) last generated: Tue Sep 25 02:54:06 +0100 2007 -

- - - -

- Generated by: SiSU 0.59.1 of 2007w39/2 (2007-09-25) -

- - - -

- Ruby version: ruby 1.8.6 (2007-06-07 patchlevel 36) [i486-linux] -

- - - - - -

- -

- - - - - - - - - - - - - - - -

- -

scroll - -

- -

- - - - - - - - -
- -
-
- - - -
- - -
- Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) -
- - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. -
- - SiSU - - is software for document structuring, publishing and search, -
- - www.jus.uio.no/sisu - - and - - www.sisudoc.org - -
- w3 since October 3 1993 - - ralph@amissah.com - -
- -
- SiSU using: -
Standard SiSU markup syntax, -
Standard SiSU meta-markup syntax, and the -
Standard SiSU object citation numbering and system, (object/text positioning system) -
- Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. -
-
-
- - - -
- -
- - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> -
- -
- SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. -
- Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. -
- Get With the Future - - Way Better! - -
-
- - - - - - - -

- -

-
- - - -
- -
-

- - - - -

- -
-

- - - - -

- - -

- - - - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/dom.xml b/data/doc/manuals_generated/sisu_manual/sisu_description/dom.xml deleted file mode 100644 index bfb6556f..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/dom.xml +++ /dev/null @@ -1,2867 +0,0 @@ - - - - - - - - -

- Title: - - SiSU - Description - -

- -

- Creator: - - Ralph Amissah - -

- -

- Rights: - - Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 - -

- -

- Type: - - information - -

- -

- Subject: - - ebook, epublishing, electronic book, electronic publishing, electronic document, electronic citation, data structure, citation systems, search - -

- -

- Date created: - - 2002-11-12 - -

- -

- Date issued: - - 2002-11-12 - -

- -

- Date available: - - 2002-11-12 - -

- -

- Date modified: - - 2007-08-30 - -

- -

- Date: - - 2007-08-30 - -

- - - - - - - - - - - - -

- - - - -

- - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - - - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - - - -

- - - -

- - - - - - -

- - - -

- - -

- - - - - - - - -

- - - -

- - -

- - - - - - - - - - -

- - - -

- - -

- - - - - - - - - - -

- - - - - - - - - - - - - - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/endnotes.html b/data/doc/manuals_generated/sisu_manual/sisu_description/endnotes.html deleted file mode 100644 index e0455d4f..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/endnotes.html +++ /dev/null @@ -1,1012 +0,0 @@ - - - - - - endnotes - - SiSU - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- - - -

- -

- - - - - - - - - - - - - - - - - -

- ^22. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> -

- -

- - - - - - -

- -

- - - - -

- -

- Description -

- Ralph Amissah - -

- -

Endnotes

- - -

- ^2. also chosen for the meaning of the Finnish term "sisu". -

- - -

- ^3. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- - -

- ^4. pdf via LaTeX or lout -

- - -

- ^5. currently html (two forms of html presentation one based on css the other on tables), and PHP; potentially structured XML -

- - -

- ^6. any SQL - currently PostgreSQL and sqlite (for portability, testing and development) -

- - -

- ^7. previously called "text object numbering" -

- - -

- ^11. <http://www.perl.org/> -

- - -

- ^12. <http://www.ruby-lang.org/en/> -

- - -

- ^13. <http://www.debian.org/> -

- - -

- ^16. objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. -

- - -

- ^18. <http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst> output provided as example in the next section -

- - -

- ^19. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> as it would appear with syntax highlighting (by vim) -

- - -

- - -

- ^23. <http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html> -

- - -

- ^24. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/toc.html> -

- - -

- ^25. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/doc.html> -

- - -

- ^26. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/landscape.pdf> -

- - -

- ^27. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/portrait.pdf> -

- - -

- ^28. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/plain.txt> -

- - -

- ^29. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/sax.xml> -

- - -

- ^30. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/dom.xml> -

- - -

- ^31. <http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/concordance.html> -

- - -

- ^32. discontinued for the time being -

- - -

- ^34. the program that generates the documents -

- - -

- ^35. <http://www.jus.uio.no/sisu/SiSU/1.html#search> -

- - -

- ^36. <http://dublincore.org/> -

- - -

- ^37. <http://www.w3.org/RDF/> -

- - -

- ^38. The previous way was directory associations for file output were set up in the configuration file. The present system is a more natural way to work requireing less configuration. -

- - -

- ^39. from a version control system such as CVS -

- - -

- ^40. The version control system must be run, so the version number is obtained, prior to the SiSU document generation, and subsequent posting of the document. -

- - -

- ^43. Scrolling is not however necessarily confined to full length documents as you will have to scroll to get to the bottom of any long segment (eg. chapter) of a segmented text. -

- - -

- ^45. formatting possibility still exists in code tree but maintenance has been largely discontinuted. -

- - -

- ^46. <http://www.mozilla.org/products/firefox/> -

- - -

- ^47. <http://kazehakase.sourceforge.jp/> -

- - -

- ^48. <http://www.konqueror.org/> -

- - -

- ^49. <http://www.mozilla.org/> -

- - -

- ^50. <http://www.microsoft.com/windows/ie/default.asp> -

- - -

- ^51. <http://home.netscape.com/comprod/mirror/client_download.html> -

- - -

- ^52. <http://www.opera.com/> -

- - -

- ^53. <http://www.dillo.org/> -

- - -

- ^54. <http://www.gnome.org/projects/epiphany/> -

- - -

- ^55. <http://galeon.sourceforge.net/> -

- - -

- ^56. <http://elinks.or.cz/> -

- - -

- ^57. <http://links.twibright.com/> -

- - -

- ^58. <http://w3m.sourceforge.net/> -

- - -

- ^59. LaTeX and pdf features introduced 18^th June 2001, Landscape and portrait pdfs introduced 7^th October 2001., Lout is a more recent addition 22^th April 2003 -

- - -

- ^60. <http://www.adobe.com/products/acrobat/readstep2.html> -

- - -

- ^61. <http://www.gnome.org/projects/evince/> -

- - -

- ^62. <http://www.foolabs.com/xpdf/> -

- - -

- ^63. <http://www.postgresql.org/>
<http://advocacy.postgresql.org/>
<http://en.wikipedia.org/wiki/Postgresql> -

- - -

- ^64. <http://www.hwaci.com/sw/sqlite/>
<http://en.wikipedia.org/wiki/Sqlite> -

- - -

- ^65. Relational database features retaining document structure and citation introduced 15^th July 2002 -

- - -

- ^66. <http://search.sisudoc.org> -

- - -

- ^67. (which could be extended further with current back-end). As regards scaling of the database, it is as scalable as the database (here Postgresql) and hardware allow. -

- - -

- ^69. OCN are provided for HTML, XML, pdf ... though currently omitted in plain-text and opendocument format output -

- - -

- ^70. Concordance/ WordMaps introduced 15^th August 2002 -

- - -

- ^71. <http://www.vim.org/> -

- - - -

- -

- - - - - - - - - - - - - - - - - -

- -

- - - - - - -

- -

- - - - -

- -

- - - - - - - - -

- -
- - - - - -	- - - Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) - - - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. - - - SiSU - - is software for document structuring, publishing and search, - - - www.jus.uio.no/sisu - - and - - www.sisudoc.org - - - w3 since October 3 1993 - - ralph@amissah.com - - -	- - SiSU using: - Standard SiSU markup syntax, - Standard SiSU meta-markup syntax, and the - Standard SiSU object citation numbering and system, (object/text positioning system) - - Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. - -
- - - - - -	- - - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> - -	- - SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. - - Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. - - Get With the Future - - Way Better! - - -

- - - - - -

-
- - - -
- -
-

- - - - -

- -
-

- - - - -

- - -

- \ No newline at end of file diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/index.html b/data/doc/manuals_generated/sisu_manual/sisu_description/index.html deleted file mode 100644 index dcdd4375..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/index.html +++ /dev/null @@ -1,704 +0,0 @@ - - - - - - SiSU - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- - - - - -

- -

- - - - - - - - - - - - - - - -

- -

toc - -

- -

- - - - -

- -

SiSU -

- -

Description -

- -

Ralph Amissah -

- -copy @ - - SiSU - - -

- -

- - SiSU - -
- Quick Ref.: -
- - Manifest - -
- - SiSU Manual - -
- - Book Samples and Markup Examples - -
- - SiSU @ Wikipedia - -
- - SiSU @ Freshmeat - -
- - SiSU @ Ruby Application Archive - -
- - SiSU @ Debian - -
- - SiSU Download - -
- - SiSU Changelog - -
- - SiSU help - -
- - SiSU help sources - -
- - SiSU electronic documents - -
- - www.jus.uio.no/sisu - -

- -

- SiSU - Description,
Ralph Amissah -

- -

- SiSU an attempt to describe -

- -

- - 1. Description - -

- -

- - 1.1 Outline - -

- -

- - 1.2 Short summary of features - -

- -

- - 1.3 How it works - -

- -

- - 1.4 Simple markup - -

- -

- - 1.4.1 Sparse markup requirement, try to get the most out of markup - -

- -

- - 1.4.2 Single markup file provides multiple output formats - -

- -

- - 1.4.3 Syntax relatively easy to read and remember - -

- -

- - 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types - -

- -

- - 1.5 Designed with usability in mind - -

- -

- - 1.6 Code separate from content - -

- -

- - 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine - -

- -

- - 1.8 Handling of Dublin Core meta-tags making use of the Resource Description Framework - -

- -

- - 1.9 Easy directory management - -

- -

- - 1.10 Document Version Control Information - -

- -

- - 1.11 Table of contents - -

- -

- - 1.12 Auto-numbering of headings - -

- -

- - 1.13 Numbering and cross-hyperlinking of endnotes - -

- -

- - 1.14 "Skinnable" - -

- -

- - 1.15 Multiple Outputs - -

- -

- - 1.15.1 html - several presentations: full length & segmented; css & table based - -

- -

- - 1.15.2 XML - -

- -

- - 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 - -

- -

- - 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) - -

- -

- - 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) - -

- -

- - 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) - -

- -

- - 1.15.7 Other forms - -

- -

- - 1.16 Concordance / Word Map or rudimentary index - -

- -

- - 1.17 Managed (document) directory, database, or site structure - -

- -

- - 1.18 Batch processing - -

- -

- - 1.19 Integration to superior Gnu/Linux and Unix tools - -

- -

- - 1.19.1 Backup and version control - -

- -

- - 1.19.2 Editor support - -

- -

- - 1.20 Modular design, need something new add a module - -

- -

- - Endnotes - -

- - - Document Information (metadata) - - -

- -

- - - - - -

- -

- - - - - - - - - - - - - - - -

- -

toc - -

- -

- - - - - - - - -

- -
- - - - - -	- - - Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) - - - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. - - - SiSU - - is software for document structuring, publishing and search, - - - www.jus.uio.no/sisu - - and - - www.sisudoc.org - - - w3 since October 3 1993 - - ralph@amissah.com - - -	- - SiSU using: - Standard SiSU markup syntax, - Standard SiSU meta-markup syntax, and the - Standard SiSU object citation numbering and system, (object/text positioning system) - - Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. - -
- - - - - -	- - - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> - -	- - SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. - - Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. - - Get With the Future - - Way Better! - - -

- - - - - - - -

- -

-
- - - -
- -
-

- - - - -

- -
-

- - - - -

- - -

- - - - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/landscape.pdf b/data/doc/manuals_generated/sisu_manual/sisu_description/landscape.pdf deleted file mode 100644 index e202e2d6..00000000 Binary files a/data/doc/manuals_generated/sisu_manual/sisu_description/landscape.pdf and /dev/null differ diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/metadata.html b/data/doc/manuals_generated/sisu_manual/sisu_description/metadata.html deleted file mode 100644 index d2b22d83..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/metadata.html +++ /dev/null @@ -1,591 +0,0 @@ - - - - - - - - SiSU - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- - - -

- -

- - - - - - - - - - - - - - - - - -

- <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sisu_manifest.html> -

- -

- - - - - - -

- -

- - - - -

- -

- SiSU -

- Description -

- Ralph Amissah - -

- copy @ - - SiSU - -

- - -

- -

- 0 -

- - -

- -

- - -

- - Metadata -

- 0 -

- -

- -

- Dublin Core (DC) -

- -

- DC tags included with this document are provided here. -

- -

- DC Title: SiSU - Description -

- -

- DC Creator: Ralph Amissah -

- -

- DC Rights: Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 -

- -

- DC Type: information -

- -

- DC Date created: 2002-11-12 -

- -

- DC Date issued: 2002-11-12 -

- -

- DC Date available: 2002-11-12 -

- -

- DC Date modified: 2007-08-30 -

- -

- DC Date: 2007-08-30 -

- -

- Version Information -

- -

- Sourcefile: sisu_description.sst -

- -

- Filetype: SiSU text 0.57 -

- -

- Sourcefile Digest, MD5(sisu_description.sst)= b89ccdad9f6d9c2260d8d383d6b35ccc -

- -

- Skin_Digest: MD5(/home/ralph/grotto/theatre/dbld/builds/sisu/sisu/data/doc/sisu/sisu_markup_samples/sisu_manual/_sisu/skin/doc/skin_sisu_manual.rb)= 20fc43cf3eb6590bc3399a1aef65c5a9 -

- -

- Generated -

- -

- Document (metaverse) last generated: Tue Sep 25 02:54:06 +0100 2007 -

- -

- Generated by: SiSU 0.59.1 of 2007w39/2 (2007-09-25) -

- -

- Ruby version: ruby 1.8.6 (2007-06-07 patchlevel 36) [i486-linux] -

- - - -

- -

- - - - - - - - - - - - - - - - - -

- -

- - - - - - -

- -

- - - - -

- -

- - - - - - - - -

- -
- - - - - -	- - - Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) - - - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. - - - SiSU - - is software for document structuring, publishing and search, - - - www.jus.uio.no/sisu - - and - - www.sisudoc.org - - - w3 since October 3 1993 - - ralph@amissah.com - - -	- - SiSU using: - Standard SiSU markup syntax, - Standard SiSU meta-markup syntax, and the - Standard SiSU object citation numbering and system, (object/text positioning system) - - Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. - -
- - - - - -	- - - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> - -	- - SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. - - Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. - - Get With the Future - - Way Better! - - -

- - - - - -

-
- - - -
- -
-

- - - - -

- -
-

- - - - -

<http://www.jus.uio.no/sisu/sisu_manual/sisu_description/>

- - -

- \ No newline at end of file diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/opendocument.odt b/data/doc/manuals_generated/sisu_manual/sisu_description/opendocument.odt deleted file mode 100644 index 1fa175f5..00000000 Binary files a/data/doc/manuals_generated/sisu_manual/sisu_description/opendocument.odt and /dev/null differ diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/plain.txt b/data/doc/manuals_generated/sisu_manual/sisu_description/plain.txt deleted file mode 100644 index a2a490e2..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/plain.txt +++ /dev/null @@ -1,1566 +0,0 @@ -SISU - DESCRIPTION, -RALPH AMISSAH -********************************** - -SISU AN ATTEMPT TO DESCRIBE -=========================== - -1. DESCRIPTION --------------- - -1.1 OUTLINE -........... - -*SiSU* is a flexible document preparation, generation publishing and search -system.[^1] - - -- [1]: This information was first placed on the web 12 November 2002; with - predating material taken from - part of a site started and - developed since 1993. See document metadata section - for information on this - version. Dates related to the development of *SiSU* are mostly contained - within the Chronology section of this document, e.g. - - -*SiSU* ("*SiSU* information Structuring Universe" or "Structured information, -Serialized Units"),[^2] is a Unix command line oriented framework for document -structuring, publishing and search. Featuring minimalistic markup, multiple -standard outputs, a common citation system, and granular search. - - -- [2]: also chosen for the meaning of the Finnish term "sisu". - -Using markup applied to a document, *SiSU* can produce plain text, HTML, XHTML, -XML, OpenDocument, LaTeX or PDF files, and populate an SQL database with -objects[^3] (equating generally to paragraph-sized chunks) so searches may be -performed and matches returned with that degree of granularity (e.g. your -search criteria is met by these documents and at these locations within each -document). Document output formats share a common object numbering system for -locating content. This is particularly suitable for "published" works -(finalized texts as opposed to works that are frequently changed or updated) -for which it provides a fixed means of reference of content. - - -- [3]: objects include: headings, paragraphs, verse, tables, images, but not - footnotes/endnotes which are numbered separately and tied to the object from - which they are referenced. - -*SiSU* is the data/information structuring and transforming tool, that has -resulted from work on one of the oldest law web projects. It makes possible the -one time, simple human readable markup of documents, that *SiSU* can then -publish in various forms, suitable for paper[^4], web[^5] and relational -database[^6] presentations, retaining common data-structure and -meta-information across the output/presentation formats. Several requirements -of legal and scholarly publication on the web have been addressed, including -the age old need to be able to reliably cite/pinpoint text within a document, -to easily make footnotes/endnotes, to allow for semantic document meta-tagging, -and to keep required markup to a minimum. These and other features of interest -are listed and described below. A few points are worth making early (and will -be repeated a number of times): - - -- [4]: pdf via LaTeX or lout - -- [5]: currently html (two forms of html presentation one based on css the other on - tables), and /PHP/; potentially structured XML - -- [6]: any SQL - currently PostgreSQL and /sqlite/ (for portability, testing and - development) - - (i) The *SiSU* document generator was the first to place material on the web - with a system that makes possible citation across different document types, - with paragraph, or rather object citation numbering[^7] a text positioning - system, available for the pinpointing of text, 1997, a simple idea from which - much benefit, and *SiSU* remains today, to the best of my knowledge, the only - multiple format e-book/ electronic-document system on the web that gives you - this possibility (including for relational databases). - - -- [7]: previously called "text object numbering" - - (ii) Markup is done once for the multiple formats produced. - - - (iii) Markup is simple, and human readable (with a little practice), in - almost all cases there is less and simpler markup required than basic html. - In any event the markup required is very much simpler than the html, LaTeX, - [lout], structured XML, ODF (OpenDocument), PostgreSQL or SQLite feed etc. - that you can have *SiSU* generate for you. - - - (iv) *SiSU* is a batch processor, dealing with as many files as you need to - generate at a time. - - - (v) Scalability is dependent on your file system (in my case Reiserfs), the - database (currently Postgresql and/or SQLite) and your hardware. - - -*SiSU* Sabaki[^8] (or just *SiSU*) is the provisional name given to the -software described here that helps structure documents for web and other -publication. The name *SiSU* is a loose anagram for something along the lines -of */"SiSU is structuring unit"/*, or /"*SiSU*, information structuring unit"/ -or the more descriptive /"Structured information, Serialized Units"/ or -*/"simple - information structuring unit"/* or the more descriptive -/"Structured information, Serialized Units"/ or what it may be directed towards -/"*semantic* and *information structuring universe*" /,[^9] tongue in cheek, -only just. Guess I'll get away with */"Simple - information Structuring -Universe"/*. *SiSU* is also a Finnish word roughly meaning guts, inner strength -and perseverance.[^10] - - -- [8]: *SiSU* Sabaki, release version. Pre-release version *SiSU* Scribe, and - version prior to that *SiSU* nicknamed Scribbler. Pre-release versions go back - several years. Both Scribbler and Scribe (still maintained) made system calls - to *SiSU*'s various parts, instead of using libraries. - -- [9]: A little universe it may be, but semantic you may have a hard time getting - away with, given the meaning the word has taken on with markup. On a document - wide basis semantic information may be provided, which can be really useful, - (and meaningful, especially) if you have a large document set, and use this - with rss feeds or in an sql database etc. On a markup level, I have little - inclination to add semantic markup formally beyond references, title, author - [Dublin Core entities? addresses?] etc. Actually this deserves a bit of - thought possibly use letter tags (including letter alias/synonyms for font - faces) to create a small set of default semantic tags, with the possibility - for per document adjustments. Will seek to permit XML entity tagging, within - *SiSU* markup and have that ignored/removed by the parts of the program that - have no use for it. - -- [10]: "Sisu refers not to the courage of optimism, but to a concept of life that - says, 'I may not win, but I will gladly give my life for what I believe.'" - Aini Rajanen, Of Finnish Ways, 1981, p. 10. - -- - -- "Every Finn has his own pet definition. To me, sisu means patience without - passion. But there are many varieties of sisu. Sisu can be a sudden outburst - or it can be the kind that lasts. A man can have both kinds. It is outside - reason. It is something in the soul. It comes from oneself. For instance, it - makes a soldier do things because he himself must, not because he has been - told." Paavo Nurmi - -- - -*SiSU* was born of the need to find a way, with minimal effort, and for as wide -a range of document types as possible, to produce high quality publishing -output in a variety of document formats. As such it was necessary to find a -simple document representation that would work across a large number of -document types, and the most convenient way(s) to produce acceptable output -formats. The project leading to this program was started in 1993 (together with -the trade law project now known as Lex Mercatoria) as an investigation of how -to effectively/efficiently place documents on the web. The unified document -handling, together with features such as paragraph numbering, endnote handling -and tables... appeared in 1996/97. *SiSU* was originally written in Perl,[^11] -and converted to *Ruby*, [^12] in 2000, one of the most impressive programming -languages in existence! In its current form it has been written to run on the -*Gnu* /Linux platform, and in particular on *Debian*, [^13] taking advantage of -many of the wonderful projects that are available there. - - -- [11]: - -- [12]: - -- [13]: - -*SiSU* markup is based on requiring the minimum markup needed to determine the -structure of a document. (This can be as little as saying in a header to look -for the word Book at a specified level and the word Chapter at another level). -*SiSU* then breaks a document into its smallest parts (at a heading, and -paragraph level) while retaining all structural information. This break up of -the document and information on its structure is taken advantage of in the -transformations made in generating the very different output types that can be -created, and in providing as much as can be for what each output type is best -at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf -or Postscript), XML (in this case, structural representation), ODF -(OpenDocument [experimental]), SQL (e.g. document search; representing -constituent parts of documents based on their structure, headings, chapters, -paragraphs as required; user control).[^14] - - -- [14]: where explicit structure is provided through the use of tagging headings, - it could be reduced (still) further, for example by reducing the number of - characters used to identify heading levels; but in many cases even that - information is not required as regular expressions can be used to extract the - implicit structure. - -From markup that is simpler and more sparse than html you get: - - -* far greater output possibilities, including html, XML, ODF (OpenDocument), -LaTeX (pdf), and SQL; - - -* the advantages implicit in the very different output possibilities; - - -* a common citation system (for all outputs - including the relational -database, search results are relevant for all outputs); - - -For more see the short summary of features provided below. - - -*SiSU* processes files with minimal tagging to produce various document outputs -including html, LaTeX or lout (which is converted to pdf) and if required loads -the structured information into an SQL database (PostgreSQL and SQLite have -been used for this). *SiSU* produces an intermediate processing format.[^15] - - -- [15]: This proved to be the easiest way to develop syntax, changes could be made, - or alternatives provided for the markup syntax whilst the intermediate markup - syntax was largely held constant. There is actually an optional second - intermediate markup format in YAML - -*SiSU* is used in constructing Lex Mercatoria or - (one of the oldest law web sites), and considerable -thought went into producing output that would be suitable for legal and -academic writings (that do not have formulae) given the limitations of html, -and publication in a wide variety of "formats", in particular in relation to -the convenient and accurate citation of text. However, the construction of Lex -Mercatoria uses only a fraction of the features available from *SiSU* today, -/vis/ generation of flat file structures, rather than in addition the building -of ("granular") SQL database content, (at an object level with relevant -relational tables, and other outputs also available). - - -1.2 SHORT SUMMARY OF FEATURES -............................. - -*(i)* markup syntax: (a) simpler than html, (b) mnemonic, influenced by -mail/messaging/wiki markup practices, (c) human readable, and easily writable, - - -*(ii)* (a) minimal markup requirement, (b) single file marked up for multiple -outputs, - - -notes: - - -* documents are prepared in a single UTF-8 file using a minimalistic mnemonic -syntax. Typical literature, documents like "War and Peace" require almost no -markup, and most of the headers are optional. - - -* markup is easily readable/parsed by the human eye, (basic markup is simpler -and more sparse than the most basic html), [this may also be converted to XML -representations of the same input/source document]. - - -* markup defines document structure (this may be done once in a header -pattern-match description, or for heading levels individually); basic text -attributes (bold, italics, underscore, strike-through etc.) as required; and -semantic information related to the document (header information, extended -beyond the Dublin core and easily further extended as required); the headers -may also contain processing instructions. - - -*(iii)* (a) multiple outputs primarily industry established and institutionally -accepted open standard formats, include amongst others: plaintext (UTF-8); -html; (structured) XML; ODF (Open Document text)l; LaTeX; PDF (via LaTeX); SQL -type databases (currently PostgreSQL and SQLite). Also produces: concordance -files; document content certificates (md5 or sha256 digests of headings, -paragraphs, images etc.) and html manifests (and sitemaps of content). (b) -takes advantage of the strengths implicit in these very different output types, -(e.g. PDFs produced using typesetting of LaTeX, databases populated with -documents at an individual object/paragraph level, making possible granular -search (and related possibilities)) - - -*(iv)* outputs share a common numbering system (dubbed "object citation -numbering" (ocn)) that is meaningful (to man and machine) across various -digital outputs whether paper, screen, or database oriented, (PDF, html, XML, -sqlite, postgresql), this numbering system can be used to reference content. - - -*(v)* SQL databases are populated at an object level (roughly headings, -paragraphs, verse, tables) and become searchable with that degree of -granularity, the output information provides the object/paragraph numbers which -are relevant across all generated outputs; it is also possible to look at just -the matching paragraphs of the documents in the database; [output indexing also -work well with search indexing tools like hyperesteier]. - - -*(vi)* use of semantic meta-tags in headers permit the addition of semantic -information on documents, (the available fields are easily extended) - - -*(vii)* creates organised directory/file structure for (file-system) output, -easily mapped with its clearly defined structure, with all text objects -numbered, you know in advance where in each document output type, a bit of text -will be found (e.g. from an SQL search, you know where to go to find the -prepared html output or PDF etc.)... there is more; easy directory management -and document associations, the document preparation (sub-)directory may be used -to determine output (sub-)directory, the skin used, and the SQL database used, - - -*(viii)* "Concordance file" wordmap, consisting of all the words in a document -and their (text/ object) locations within the text, (and the possibility of -adding vocabularies), - - -*(ix)* document content certification and comparison considerations: (a) the -document and each object within it stamped with an md5 hash making it possible -to easily check or guarantee that the substantive content of a document is -unchanged, (b)version control, documents integrated with time based source -control system, default RCS or CVS with use of $Id: sisu_description.sst,v 1.25 -2007/08/23 12:22:36 ralph Exp $ tag, which *SiSU* checks - - -*(x)* *SiSU*'s minimalist markup makes for meaningful "diffing" of the -substantive content of markup-files, - - -*(xi)* easily skinnable, document appearance on a project/site wide, directory -wide, or document instance level easily controlled/changed, - - -*(xii)* in many cases a regular expression may be used (once in the document -header) to define all or part of a documents structure obviating or reducing -the need to provide structural markup within the document, - - -*(xiii)* prepared files may be batch process, documents produced are static -files so this needs to be done only once but may be repeated for various -reasons as desired (updated content, addition of new output formats, updated -technology document presentations/representations) - - -*(xiv)* possible to pre-process, which permits: the easy creation of standard -form documents, and templates/term-sheets, or; building of composite documents -(master documents) from other sisu marked up documents, or marked up parts, -i.e. import documents or parts of text into a main document should this be -desired - - -there is a considerable degree of future-proofing, output representations are -"upgradeable", and new document formats may be added. - - -*(xv)* there is a considerable degree of future-proofing, output -representations are "upgradeable", and new document formats may be added: (a) -modular, (thanks in no small part to *Ruby*) another output format required, -write another module.... (b) easy to update output formats (eg html, XHTML, -LaTeX/PDF produced can be updated in program and run against whole document -set), (c) easy to add, modify, or have alternative syntax rules for input, -should you need to, - - -*(xvi)* scalability, dependent on your file-system (ext3, Reiserfs, XFS, -whatever) and on the relational database used (currently Postgresql and -SQLite), and your hardware, - - -*(xvii)* only marked up files need be backed up, to secure the larger document -set produced, - - -*(xviii)* document management, - - -*(xix)* Syntax highlighting for *SiSU* markup is available for a number of text -editors. - - -*(xx)* remote operations: (a) run *SiSU* on a remote server, (having prepared -sisu markup documents locally or on that server, i.e. this solution where sisu -is installed on the remote server, would work whatever type of machine you -chose to prepare your markup documents on), (b) generated document outputs may -be posted by sisu to remote sites (using rsync/scp) (c)document source -(plaintext utf-8) if shared on the net may be identified by its url and -processed locally to produce the different document outputs. - - -*(xxi)* document source may be bundled together (automatically) with associated -documents (multiple language versions or master document with inclusions) and -images and sent as a zip file called a sisupod, if shared on the net these too -may be processed locally to produce the desired document outputs, these may be -downloaded, shared as email attachments, or processed by running sisu against -them, either using a url or the filename. - - -*(xxii)* for basic document generation, the only software dependency is *Ruby*, -and a few standard Unix tools (this covers plaintext, html, XML, ODF, LaTeX). -To use a database you of course need that, and to convert the LaTeX generated -to PDF, a LaTeX processor like tetex or texlive. - - -as a developers tool it is flexible and extensible - - -*SiSU* was developed in relation to legal documents, and is strong across a -wide variety of texts (law, literature...). *SiSU* handles images but is not -suitable for formulae/ statistics, or for technical writing at this time. - - -*SiSU* has been developed and has been in use for several years. Requirements -to cover a wide range of documents within its use domain have been explored. - - -Some modules are more mature than others, the most mature being Html and LaTeX -/ pdf. PostgreSQL and search functions are useable and together with /ocn/ -unique (to the best of my knowledge). The XML output document set is "well -formed" but largely proof of concept. - - -1.3 HOW IT WORKS -................ - -*SiSU* markup is fairly minimalistic, it consists of: a (largely optional) -document header, made up of information about the document (such as when it was -published, who authored it, and granting what rights) and any processing -instructions; and markup within text which is related to document structure and -typeface. *SiSU* must be able to discern the structure of a document, (text -headings and their levels in relation to each other), either from information -provided in the instruction header or from markup within the text (or from a -combination of both). Processing is done against an abstraction of the document -comprising of information on the document's structure and its objects,[^16] -which the program serializes (providing the object numbers) and which are -assigned hash sum values based on their content. This abstraction of -information about document structure, objects, (and hash sums), provides -considerable flexibility in representing documents different ways and for -different purposes (e.g. search, document layout, publishing, content -certification, concordance etc.), and makes it possible to take advantage of -some of the strengths of established ways of representing documents, (or indeed -to create new ones). - - -- [16]: objects include: headings, paragraphs, verse, tables, images, but not - footnotes/endnotes which are numbered separately and tied to the object from - which they are referenced. - -1.4 SIMPLE MARKUP -................. - -*SiSU* markup is based on requiring the minimum markup needed to determine the -structure of a document. (This can be as little as saying in a header to look -for the word Book at a specified level and the word Chapter at another level). -*SiSU* then breaks a document into its smallest parts (at a heading, and -paragraph level) while retaining all structural information. This break up of -the document and information on its structure is taken advantage of in the -transformations made in generating the very different output types that can be -created, and in providing as much as can be for what each output type is best -at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf -or Postscript), XML (in this case, structural representation), ODF -(OpenDocument), SQL (e.g. document search; representing constituent parts of -documents based on their structure, headings, chapters, paragraphs as required; -user control).[^17] - - -- [17]: where explicit structure is provided through the use of tagging headings, - it could be reduced (still) further, for example by reducing the number of - characters used to identify heading levels; but in many cases even that - information is not required as regular expressions can be used to extract the - implicit structure. - -1.4.1 SPARSE MARKUP REQUIREMENT, TRY TO GET THE MOST OUT OF MARKUP -.................................................................. - -One of its strengths is that very small amounts of initial tagging is required -for the program to generate its output. - - -This is a basic markup example: - - -* basic markup example, text file - an international convention [link:] - -[^18] - - -- [18]: - output provided as example in the next section - -* view basic markup, as it would be highlighted by vim editor [link:] - -[^19] - - -- [19]: - as it would appear with syntax highlighting (by vim) - -Emphasis has been on simplicity and minimalism in markup requirements. Design -philosophy is to try keep the amount of markup required low, for whatever has -been determined to be acceptable output.[^20] - - -- [20]: seems there are several "smart ASCIIs" available, primarily for ascii to - html conversion, that make this, and reasonable looking ascii their goal - -- - -- - -- - -*SiSU*'s markup is more minimalistic and simpler than (the equivalent) html and -for it, you get considerably more than just html, as this preparation gives you -all available output formats, upon request. - - -1.4.2 SINGLE MARKUP FILE PROVIDES MULTIPLE OUTPUT FORMATS -......................................................... - -For each document, there is only one (input, minimalistically marked up) file -from which all the available output types are generated.[^21] - - -- [21]: These include richly laid out and linked html (table or css variants), - /PHP/, LaTeX (from which pdf portrait and landscape documents are produced), - texinfo (for info files etc.), and PostgreSQL and/or SQLite. And the - opportunity to fairly easily build additional modules, such as XML. See the - examples provided in this document. - -Eg. the markup example: - - -* original text file - an international convention [link:] - -[^22] - - -- [22]: - -* view as syntax would be highlighted by vim editor [link:] - -[^23] - - -- [23]: - -Produces the following output: - - -* Segmented html version of document [link:] - -[^24] - - -- [24]: - -* Full length html document [link:] - -[^25] - - -- [25]: - -* pdf landscape version of document [link:] - -[^26] - - -- [26]: - -* pdf portrait version of document [link:] - -[^27] - - -- [27]: - -* clean tex ascii version of document [link:] - -[^28] - - -- [28]: - -* /xml/ sax version of document [link:] - -[^29] - - -- [29]: - -* /xml/ dom version of document [link:] - -[^30] - - -- [30]: - -* Concordance [link:] - -[^31] - - -- [31]: - -(and in addition to these: PostgreSQL, SQLite, texinfo and ~~YAML~~ -[^32] versions if desired) - - -- [32]: discontinued for the time being - -1.4.3 SYNTAX RELATIVELY EASY TO READ AND REMEMBER -................................................. - -Syntax is kept simple and mnemonic.[^33] - - -- [33]: *SiSU* markup syntax, an incomplete summary: - - -- Visual check of elementary font face modifiers: *bold* *bold* - emphasis /italics/ _underscore_ ~~strikethrough~~ - ^superscript^ [subscript] - -1.4.4 KEPT SIMPLE BY HAVING A LIMITED PUBLISHING FEATURE SET, AND FEATURES -IDENTIFIED AS MOST IMPORTANT, ARE AVAILABLE ACROSS SEVERAL DOCUMENT TYPES -.............................................................................. - -To keep *SiSU* markup sparse and simple *SiSU* deliberately provides a limited -publishing feature set, including: indent levels; bold; italics; superscript; -subscript; simple tables; images; tables of contents and; endnotes. Which in -most cases are available across the different output formats. - - -The publishing feature set may be expanded as required. - - -1.5 DESIGNED WITH USABILITY IN MIND -................................... - -Output is designed to be uniform, easy to read, navigate and cite. - - -1.6 CODE SEPARATE FROM CONTENT -.............................. - -Code[^34] is separated from content. This means that when changes are desired -in the output presentation, the code that produces them, and not the marked up -text data set (which could be thousands of documents) is modified. Separating -code from content makes large scale changes to output appearance trivial, and -permits the easy addition of new output modules. - - -- [34]: the program that generates the documents - -1.7 OBJECT CITATION NUMBERING, A TEXT OR OBJECT POSITIONING / CITATION SYSTEM - -"PARAGRAPH" (OR TEXT OBJECT) NUMBERING, THAT REMAINS SAME AND USABLE ACROSS ALL -OUTPUT FORMATS BY PEOPLE AND MACHINE -.............................................................................. - -Object citation numbering is a simple object (text) positioning and cition -system that is human relevant and machine useable, used by *SiSU* for all -manner of presentations, and that is available for use in all text mappings. It -is based on the automated sequential numbering of objects (roughly paragraphs, -(headings, tables, verse) or other blocks of text or images etc.). The text -positioning system (in which I claim copyright) is invaluable for publishing -requiring the citing text across multiple output formats, and for the general -mapping of text within a document: - - -* in html, html not being easily citeable (change font size, or use a different -browser and the page on which specific text appears has changed), and - - -* across multiple formats being common to all output formats html/xml/pdf/sql -output, - - -* the results of an sql search can just be "live" citation references to the -documents in which the text is found, much like an index (see image examples -provided). [link:] [^35] - - -- [35]: - -I claim copyright on the system I use which is the most basic of all, numbering -all text in headings and paragraphs sequentially (with tables and images being -treated as a single paragraph) and only footnotes/endnotes not following this -numbering, as their position in text is not strictly determined, (a change from -footnotes to endnotes would change their numbering), footnotes instead "belong" -to the paragraph from which they are referenced, and have sequential numbers of -their own. - - -*SiSU* has a paragraph numbering system, that remains the same regardless of -the output format. This provides an effective means of citation, pinpointing -text accurately in all output formats, using the same reference. This is -particularly useful where text has to be located across different output -formats - for example once html is printed the number of pages and pages on -which given text is found will vary depending on the browser, its settings the -font size setting etc. Similarly *SiSU* produces pdf in different forms, eg. on -the example site Lex Mercatoria as portrait and landscape documents - here too -page numbering varies, but paragraph numbering is the same, /vis a vis/ all -versions of the text (portrait and landscape pdf and the html versions of the -text, and as stored (with "paragraphs" as records) to the PostgreSQL or SQLite -database). - - -These numbers are placed in the text margins and are intended to be independent -of and not to interfere with authors tagging. [The citation system (object -citation numbering system, automated "paragraph numbering") which is -automatically generated and is common and identical across all document -formats] The paragraph numbering system is more accurately described as an -(text) object numbering system, as headings are also numbered... all headings -and paragraphs are numbered sequentially. Endnotes are automatically numbered -independently and rather "belong" to the paragraph from which they are -referenced, as an endnote does not (necessarily) form a part of a documents -sequence, (they may be produced as either endnotes or footnotes (or both -depending on what output you choose to look at - if you take the segmented html -version document provided as an example, you will find that the endnotes are -placed both at the end of each section, and in a separate section of their own -called endnotes, and these are hyper-linked)). An attractive feature of -providing citation numbering in this way is that it is independent of the -document structure... it remains the same regardless of what is done about the -document structure. - - -The rules have been kept very simple, unique incremental object citation -numbers are assigned to headings, paragraphs, verse, tables and images. It is -possible to manually override this feature on a per heading or comment basis -though this should be used exceptionally, it may be of use where there a -substantive text, and the addition of a minor comment by the publisher that -should not be mapped as part of the text. - - -The object citation number markers contain additional numbering information -with regard to the document structure, that can be used for alternative -presentations, including such detail as the type of object (heading, paragraph, -table, image, etc.), numbered sequentially. - - -An advantage is that the numbering remains the same regardless of document -structure. - - -Text object ("paragraph") numbering is the same for all output versions of the -same document, vis html, pdf, pgsql, yaml etc. - - -In the relational database, as individual text objects of a document stored -(and indexed) together with object numbers, and all versions of the document -have the same numbering, the results of searches may be tailored just to -provide the location of the search result in all available document formats. - - -/ Note: there is a bug in the released behaviour of object citation numbering, -(not certain when it was introduced) tables should be numbered, ie each table -gets an ocn, required amongst other things for relational database. This will -be corrected in a future release. Citation numbering of existing documents that -contain tables will changed. / - - -1.8 HANDLING OF DUBLIN CORE META-TAGS MAKING USE OF THE RESOURCE DESCRIPTION -FRAMEWORK -.............................................................................. - -*SiSU* is able to use meta tags based on the Dublin Core[^36] and Resource -Description Framework[^37] - - -- [36]: - -- [37]: - -This provides the means of providing semantic information about a document, -both as computer processable meta-tags, and as human readable information that -may be of value for classification purposes. - - -This information is provided both in html metatags, and (where available) under -the section titled "Document Information - MetaData", near the end of a -document, for example in the segmented html version of this text at: - - - -1.9 EASY DIRECTORY MANAGEMENT -............................. - -1. Directory file association, skins and special image management, made -simpler.[^38] - - -- [38]: The previous way was directory associations for file output were set up in - the configuration file. The present system is a more natural way to work - requireing less configuration. - -The last part of the name of the work directory in which markup is being done, -or rather from where *SiSU* is run in order to generate document output, is -used in determining the sub-directory name for output files, that is created in -the document output directory. This provides a rather easy way to associate -documents e.g. of a given subject, or by owner. - - - - /www/docs - /intellectual_property - /arbitration - /contract_law - /www/docs - /ralph - /sisu - -all are placed in their own directories within the directory structure created. -Similar rules are used in the creation of sql type databases (though they can -be overridden). - - -There are a couple of further associations with these directories. - - -Directory wide skins. - - -Directory specific images. - - -2. If there is a "directory skin", that is a skin of the same name as the -directory, it is used in the generation of the documents within it, rather than -the default skin, unless the document has a specific skin associated with it. - - - a. default skin (always available) - - - b. directory skin (precedence over default if exists) - - - c. document skin (takes precedence wherever document requests a specific - skin) - - -Skins are defined in the document skin directory and if a directory association -is desired a softlink made to the relevant skin. Skins (directory association -auto load) auto load skin if a directory skin exists of same name as directory -stub, (and there is no specific doc skin) - - -3. If the working directory has within it a sub-directory called image_local, -the images within that directory are used for references to images, that are -not part of the default site build. - - -1.10 DOCUMENT VERSION CONTROL INFORMATION -......................................... - -The possibility of citing an exact document version. - - -Permits the inclusion of document version control information to the document -body and metatags.[^39] This provides a much more certain method of referring -to the exact version of a particular document, (assuming that the document is -from a trusted source, that will retain earlier versions of a document).[^40] - - -- [39]: from a version control system such as CVS - -- [40]: The version control system must be run, so the version number is obtained, - prior to the *SiSU* document generation, and subsequent posting of the - document. - -This information (where available) is provided under the section of the -document titled "Document Information - MetaData", near the end of a document, -for example in the segmented html version of this text at: - - - -1.11 TABLE OF CONTENTS -...................... - -*SiSU* produces a rudimentary a table of contents based on document headings. - - -1.12 AUTO-NUMBERING OF HEADINGS -............................... - -Headings can be automatically numbered, (and automatically named for -hyper-linking) - - -1.13 NUMBERING AND CROSS-HYPERLINKING OF ENDNOTES -................................................. - -*SiSU* can automatically number footnotes/endnotes. This is the default -operation where no number is provided. - - -Footnotes/endnotes may also be manually numbered. Where a number, or numbers -are provided for a footnote/endnote, this does not increment the automatic -footnote/endnote number counter. - - -In the html output footnotes/endnotes are cross-hyper-linked (to their -reference point and vice versa). In th pdf output footnotes are linked from -their reference point only. - - -1.14 "SKINNABLE" -................ - -*SiSU* is skinnable, on a site-wide, directory-wide and per document basis, so -different looking versions of things may be produced with little difficulty. -There is a default skin which may be modified, as the background site skin, and -each working directory may have a skin associated with it, as may each -individual document. The hierarchy of application is document, directory, then -site... ie if a document skin exists it gets precedence. - - -Whilst it is skinnable, the default output styles are selected to work across -the widest possible range of document types. - - -1.15 MULTIPLE OUTPUTS -..................... - -From markup that is simpler and more sparse than html you get: - - -* far greater output possibilities, including multiple html types, XML -(different structured types), LaTeX (pdf landscape, portrait), and SQL -(Postgresql or SQLite or other); - - -* the advantages implicit in these very different output possibilities;[^41] - - -- [41]: e.g. LaTeX (professional document typesetting, easy conversion to pdf or - Postscript), XML (in this case, structural representation), SQL (e.g. document - set searches; representation of the constituent parts of documents based on - their structure, headings, chapters, paragraphs as desired; control of use) - -* a common citation system - - -As many output formats/presentations as one cares to write modules for - -several types of html (e.g. structure based on css, or structure based on -tables); /LaTeX/pdf/ and /Lout/pdf/; pgsql other databases easily added; -yaml... - - -1.15.1 HTML - SEVERAL PRESENTATIONS: FULL LENGTH & SEGMENTED; CSS & TABLE BASED -.............................................................................. - -Most documents are produced in single and segmented html versions, described -below: - - -*The Scroll (full length text presentations)* - - -The full length of the text in a single scrollable document.[^42] As a rule the -files they are saved in are named: /doc/ or more precisely /doc.html/ - - -- [42]: CISG - - -- The Unidroit Contract Principles - or - -- The Autonomous Contract - - -For various reasons texts may only be provided in this form (such as this one -which is short), though most are also provided as segmented texts. - - -"Scroll" is a reference to the historical scroll, a single long document/ -parchment, and also no doubt to what you will have to do to get to the bottom -of the text.[^43] - - -- [43]: Scrolling is not however necessarily confined to full length documents as - you will have to scroll to get to the bottom of any long segment (eg. chapter) - of a segmented text. - -*The Segmented Text* - - -The text divided into segments (such as articles or chapters depending on the -text)[^44] As a rule the files they are saved in are named: /toc/ and /index/ -or more precisely /toc.html/ and /index.html/ - - -- [44]: CISG - - -- The Unidroit Principles - - -- The Autonomous Contract - or - -- WTA 1994 - -If you know exactly what you are looking for, loading a segment of text is -faster (the segments being smaller). Occasionally longer documents such as the -WTA 1994 are only provided in segmented -form. - - -*Cascading Style Sheet, and Table based html* - - -*SiSU* outputs html, two current standard forms available are: - - -css based [link:] - - -and - - -table based [largely discontinued ][^45] - - -- [45]: formatting possibility still exists in code tree but maintenance has been - largely discontinuted. - -*The html is tested across several browsers* - - -I like to remind you that there are other excellent browsers out there, many of -which have long supported practical features like tabbing. - - -The html is tested across several browsers, including: - - -* *Firefox* (Mozilla-Firefox) [link:] - [^46] - - -- [46]: - -* Kazehakase [link:] [^47] - - -- [47]: - -* Konqueror [link:] [^48] - - -- [48]: - -* Mozilla [link:] [^49] - - -- [49]: - -* MS Internet Explorer [link:] - [^50] - - -- [50]: - -* Netscape [link:] - [^51] - - -- [51]: - -* Opera [link:] [^52] - - -- [52]: - -Also lighter weight graphical browsers: - - -* Dillo [link:] [^53] - - -- [53]: - -* *Epiphany* [link:] [^54] - - -- [54]: - -* *Galeon* [link:] [^55] - - -- [55]: - -And for console/text browsing: - - -* *elinks* [link:] [^56] - - -- [56]: - -* *links2* [link:] [^57] - - -- [57]: - -* *w3m* [link:] [^58] - - -- [58]: - -The html tables output is rendered more accurately across a wider variety set -and older versions of browsers (than the html css output). - - -1.15.2 XML -.......... - -*SiSU* generates well formed XML, and multiple versions. An XML SAX version -with a flat/shallow structure, and XML DOM version with a deeper (embedded) -structure. There is also a released working xhtml module. Examples of SAX and -DOM versions are provided within this document. - - -1.15.3 ODT:ODF, OPEN DOCUMENT FORMAT - ISO/IEC 26300:2006 -......................................................... - -*SiSU* generates Open Document Output format. - - -1.15.4 PDF - PORTRAIT AND LANDSCAPE, (THROUGH THE GENERATION OF LATEX OUTPUT -WHICH IS THEN TRANSFORMED TO PDF) -.............................................................................. - -*SiSU* outputs LaTeX if required which is easily transformed to PDF.[^59] PDF -documents are generated on the site from the same source files and *Ruby* -program that produce html. Landscape oriented pdf introduced, providing easier -screen viewing, they are also (paper saving, being currently) formatted to have -fewer pages than their portrait equivalents. - - -- [59]: LaTeX and pdf features introduced 18^th^ June 2001, Landscape and portrait - pdfs introduced 7^th^ October 2001., Lout is a more recent addition 22^th^ - April 2003 - -* Adobe Reader [link:] -[^60] - - -- [60]: - -* *Evince* [link:] [^61] - - -- [61]: - -* xpdf [link:] [^62] - - -- [62]: - -1.15.5 SEARCH - LOADING/POPULATING OF RELATIONAL DATABASE WHILE RETAINING -DOCUMENT STRUCTURE INFORMATION, OBJECT CITATION NUMBERING AND OTHER FEATURES -(CURRENTLY POSTGRESQL AND/OR SQLITE) -.............................................................................. - -*SiSU* (from the same markup input file) automatically feeds into -PostgreSQL[^63] and/or SQLite[^64] database (could be any other of the better -relational databases)[^65] - together with all additional information related -to document structure, and the alternative ways in which it is generated on the -site retained. As regards scaling of the database, it is as scalable as the -database (here Postgresql or SQLite) and hardware allow. I will prune the -images later. - - -- [63]: - -- - -- - -- [64]: - -- - -- [65]: Relational database features retaining document structure and citation - introduced 15^th^ July 2002 - -This is one of the more interesting output forms, as all the structural data -for the documents are retained (though can be ignored by the user of the -database should they so choose). All site texts/documents are (currently) -streamed to four pgsql database tables: - - - * one containing semantic (and other) headers, including, title, author, - subject, (the Dublin Core...); - - - * another the substantive texts by individual "paragraph" (or object) - along - with structural information, each paragraph being identifiable by its - paragraph number (if it has one which almost all of them do), and the - substantive text of each paragraph quite naturally being searchable (both in - formatted and clean text versions for searching); and - - - * a third containing endnotes cross-referenced back to the paragraph from - which they are referenced (both in formatted and clean text versions for - searching). - - - * a fourth table with a one to one relation with the headers table contains - full text versions of output, eg. pdf, html, xml, and ascii. - - -There is of course the possibility to add further structures. - - -At this level *SiSU* loads a relational database with documents broken in to -their smallest logical structurally constituent parts, as text objects, with -their object citation number and all other structural information needed to -construct the structured document. Text is stored (at this text object level) -with and without elementary markup tagging, the stripped version being so as to -facilitate ease of searching. - - -Because the document structure of sites created is clearly defined, and the -text object citation system is available for all forms of output, it is -possible to search the sql database, and either read results from that -database, or just as simply map the results to the html output, which has -richer text markup. - - -The combination of the *SiSU* citation system with a relational database is -pretty powerful, giving rise to several possibilities. As individual text -objects of a document stored (and indexed) together with object numbers, and -all versions of the document have the same numbering, complex searches can be -tailored to return just the locations of the search results relevant for all -available output formats, with live links to the precise locations in the -database or in html/xml documents; or, the structural information provided -makes it possible to search the full contents of the database and have headings -in which search content appears, or to search only headings etc. (as the Dublin -Core is incorporated it is easy to make use of that as well). - - -This is a larger scale project, (with little development on the front end -largely ignored), though the "infrastructure" has been in place since 2002. - - -1.15.6 SEARCH - DATABASE FRONTEND SAMPLE, UTILISING DATABASE AND SISU FEATURES, -INCLUDING OBJECT CITATION NUMBERING (BACKEND CURRENTLY POSTGRESQL) -.............................................................................. - -Sample search frontend [link:] [^66] A small -database and sample query front-end (search from) that makes use of the -citation system, _object citation numbering_ to demonstrates -functionality.[^67] - - -- [66]: - -- [67]: (which could be extended further with current back-end). As regards scaling - of the database, it is as scalable as the database (here Postgresql) and - hardware allow. - -*SiSU* can provide information on which documents are matched and at what -locations within each document the matches are found. These results are -relevant across all outputs using object citation numbering, which includes -html, XML, LaTeX, PDF and indeed the SQL database. You can then refer to one of -the other outputs or in the SQL database expand the text within the matched -objects (paragraphs) in the documents matched. - - -(further work needs to be done on the sample search form, which is rudimentary -and only passes simple booleans correctly at present to the SQL engine) - - -A few canned searches, showing object numbers. Search for: - - -English documents matching Linux OR Debian [link:] - - - -GPL OR Richard Stallman [link:] - - - -invention OR innovation in English language [link:] - - - -copyright in English language documents [link:] - - - -Note that the searches done in this form are case sensitive. - - -Expand those same searches, showing the matching text in each document: - - -English documents matching Linux OR Debian [link:] - - - -GPL OR Richard Stallman [link:] - - - -invention OR innovation in English language [link:] - - - -copyright in English language documents [link:] - - - -Note you may set results either for documents matched and object number -locations within each matched document meeting the search criteria; or display -the names of the documents matched along with the objects (paragraphs) that -meet the search criteria.[^68] - - -- [68]: of this feature when demonstrated to an IBM software innovations evaluator - in 2004 he said to paraphrase: this could be of interest to us. We have large - document management systems, you can search hundreds of thousands of documents - and we can tell you which documents meet your search criteria, but there is no - way we can tell you without opening each document where within each your - matches are found. - -*OCN index mode,* (object citation number) the numbers displayed are relevant -(and may be used to reference the match) in any sisu generated rendition of the -text[^69] the links provided are to the locations of matches within the html -generated by *SiSU*. - - -- [69]: OCN are provided for HTML, XML, pdf ... though currently omitted in - plain-text and opendocument format output - -*Paragraph mode,* you may alternatively display the text of each paragraph in -which the match was made, again the object/paragraph numbers are relevant to -any *SiSU* generated/published text. - - -Several options for output - select database to search, show results in index -view (links to locations within text), show results with text, echo search in -form, show what was searched, create and show a "canned url" for search, show -available search fields. Also shows counters number of documents in which found -and number of locations within documents where found. [could consider sorting -by document with most occurrences of the search result]. - - -Earlier version of the search frontend - Simple search, results with files in -which search found, and locations where found within files. - - -Simple search, results with files in which search found, and text object -(paragraph or endnote) where found within files. - - -1.15.7 OTHER FORMS -.................. - -There are other forms as well, YAML file, *Ruby* Marshal dumps, document -pre-processing (processing of documents prior to the steps described here, to -produce input suitable for the program) snap in a new module as -required/desired, well formed XML, no problem. - - -1.16 CONCORDANCE / WORD MAP OR RUDIMENTARY INDEX -................................................ - -Concordance /WordMaps:[^70] *SiSU* produces a rudimentary index based on the -words within the text, making use of paragraph numbers to identify text -locations. This is generated in html and hyper-linked but identifies these -words locations in the other document formats. Though it is possible to search -using a search engine, this is a means for browsing an alphabetical list of -words which may suggest other useful content. - - -- [70]: Concordance/ WordMaps introduced 15^th^ August 2002 - -1.17 MANAGED (DOCUMENT) DIRECTORY, DATABASE, OR SITE STRUCTURE -.............................................................. - -*SiSU* builds the web site (or more generically provides a suitable directory -structure) - placing various output texts in the hierarchy of the web-site (or -db), which (for directories) is a sub-directory with the name of the text file. - - -1.18 BATCH PROCESSING -..................... - -*SiSU* is a batch processing tool, handling and transforming multiple (or -individual) documents (in many ways) with a single instruction. - - -1.19 INTEGRATION TO SUPERIOR GNU/LINUX AND UNIX TOOLS -..................................................... - -As should have been noted by the above description of *SiSU*, it makes use of -existing programs found on *Gnu* /Linux and Unix, amongst those already -mentioned include the LaTeX to pdf converters and the database PostgreSQL or -SQLite. - - -1.19.1 BACKUP AND VERSION CONTROL -................................. - -Unix provides many tools for version control. For documents Subversion, CVS and -even the old RCS are useful for the per-document histories they provide. - - -For writing code superior (more recent) version control system exist. These can -also be used for documents though they tend to take stamps of changes across -the repository as a whole, rather than for each individual file that is -tracked, (as CVS and RCS do). My personal preference is for distributed systems -such as Git, Mercurial or Darcs, of which I use Git for both code and -documents. - - -Several backup tools exist. At the base level I tend to use rdiff. - - -1.19.2 EDITOR SUPPORT -..................... - -*SiSU* documents are prepared / marked up in utf-8 text _you are free to use -the text editor of your choice._ - - -Syntax highlighting for a number of editors are provided. Amongst them Vim, -Kwrite, Kate, Gedit and diakonos. These may be found with configuration -instructions at . Vim [link:] - [^71] as of version 7 has built in sytax highlighting for -*SiSU*. - - -- [71]: - -1.20 MODULAR DESIGN, NEED SOMETHING NEW ADD A MODULE -.................................................... - -Need a new output format that does not already exist, write a new module. - - -Prefer a new input syntax, you could write a new syntax matching the existing -design, though my personal preference is some uniformity in entry appearance. -If necessary has been fairly easy to extend the design parameters. It is -intended to incorporate some additional basic semantic tagging, (book, article, -author etc.) However, keeping the requirements for input minimal, and -relatively simple has been a design goal. - - -DOCUMENT INFORMATION (METADATA) -******************************* - -METADATA --------- - -Document Manifest @ - - - -*Dublin Core* (DC) - - -/DC tags included with this document are provided here./ - - -DC Title: _SiSU - Description_ - - -DC Creator: _Ralph Amissah_ - - -DC Rights: _Copyright (C) Ralph Amissah 2007, part of SiSU documentation, -License GPL 3_ - - -DC Type: _information_ - - -DC Date created: _2002-11-12_ - - -DC Date issued: _2002-11-12_ - - -DC Date available: _2002-11-12_ - - -DC Date modified: _2007-08-30_ - - -DC Date: _2007-08-30_ - - -*Version Information* - - -Sourcefile: _sisu_description.sst_ - - -Filetype: _SiSU text 0.57_ - - -Sourcefile Digest, MD5(sisu_description.sst)= -_b89ccdad9f6d9c2260d8d383d6b35ccc_ - - -Skin_Digest: -MD5(/home/ralph/grotto/theatre/dbld/builds/sisu/sisu/data/doc/sisu/sisu_markup_samples/sisu_manual/_sisu/skin/doc/skin_sisu_manual.rb)= -_20fc43cf3eb6590bc3399a1aef65c5a9_ - - -*Generated* - - -Document (metaverse) last generated: _Tue Sep 25 02:54:06 +0100 2007_ - - -Generated by: _SiSU_ _0.59.1_ of 2007w39/2 (2007-09-25) - - -Ruby version: _ ruby 1.8.6 (2007-06-07 patchlevel 36) [i486-linux]_ - - - -============================================================================== - - title: SiSU - Description - - creator: Ralph Amissah - - rights: Copyright (C) Ralph Amissah 2007, part of SiSU documentation, - License GPL 3 - - type: information - - subject: ebook, epublishing, electronic book, electronic publishing, - electronic document, electronic citation, data structure, - citation systems, search - - date.created: 2002-11-12 - - date.issued: 2002-11-12 - - date.available: 2002-11-12 - - date.modified: 2007-08-30 - - date: 2007-08-30 - - - - - -============================================================================== -nil - -Other versions of this document: -manifest: - http://www.jus.uio.no/sisu/sisu_description/sisu_manifest.html -html: - http://www.jus.uio.no/sisu/sisu_description/toc.html -pdf: - http://www.jus.uio.no/sisu/sisu_description/portrait.pdf - http://www.jus.uio.no/sisu/sisu_description/landscape.pdf -plaintext (plain text): - http://www.jus.uio.no/sisu/sisu_description/plain.txt -at: - http://www.jus.uio.no/sisu -* Generated by: SiSU 0.59.1 of 2007w39/2 (2007-09-25) -* Ruby version: ruby 1.8.6 (2007-06-07 patchlevel 36) [i486-linux] -* Last Generated on: Tue Sep 25 02:54:08 +0100 2007 -* SiSU http://www.jus.uio.no/sisu diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/portrait.pdf b/data/doc/manuals_generated/sisu_manual/sisu_description/portrait.pdf deleted file mode 100644 index a8a9eda1..00000000 Binary files a/data/doc/manuals_generated/sisu_manual/sisu_description/portrait.pdf and /dev/null differ diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/sax.xml b/data/doc/manuals_generated/sisu_manual/sisu_description/sax.xml deleted file mode 100644 index 32a2265b..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/sax.xml +++ /dev/null @@ -1,2731 +0,0 @@ - - - - - - - Title: - - SiSU - Description - -
- Creator: - - Ralph Amissah - -
- Rights: - - Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 - -
- Type: - - information - -
- Subject: - - ebook, epublishing, electronic book, electronic publishing, electronic document, electronic citation, data structure, citation systems, search - -
- Date created: - - 2002-11-12 - -
- Date issued: - - 2002-11-12 - -
- Date available: - - 2002-11-12 - -
- Date modified: - - 2007-08-30 - -
- Date: - - 2007-08-30 - -
- - -

- - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/scroll.xhtml b/data/doc/manuals_generated/sisu_manual/sisu_description/scroll.xhtml deleted file mode 100644 index beb9e0af..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/scroll.xhtml +++ /dev/null @@ -1,2519 +0,0 @@ - - - - - - - - Title: - - SiSU - Description - -
- Creator: - - Ralph Amissah - -
- Rights: - - Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 - -
- Type: - - information - -
- Subject: - - ebook, epublishing, electronic book, electronic publishing, electronic document, electronic citation, data structure, citation systems, search - -
- Date created: - - 2002-11-12 - -
- Date issued: - - 2002-11-12 - -
- Date available: - - 2002-11-12 - -
- Date modified: - - 2007-08-30 - -
- Date: - - 2007-08-30 - -
- - -

- - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_description.sst b/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_description.sst deleted file mode 100644 index 05930df7..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_description.sst +++ /dev/null @@ -1,557 +0,0 @@ -% SiSU 0.57 - -@title: SiSU - -@subtitle: Description - -@creator: Ralph Amissah - -@rights: Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3 - -@type: information - -@subject: ebook, epublishing, electronic book, electronic publishing, electronic document, electronic citation, data structure, citation systems, search - -@date.created: 2002-11-12 - -@date.issued: 2002-11-12 - -@date.available: 2002-11-12 - -@date.modified: 2007-08-30 - -@date: 2007-08-30 - -@level: new=C; break=1; num_top=1 - -@skin: skin_sisu_manual - -@bold: /Gnu|Debian|Ruby|SiSU/ - -@links: { SiSU Manual }http://www.jus.uio.no/sisu/sisu_manual/ -{ Book Samples and Markup Examples }http://www.jus.uio.no/sisu/SiSU/2.html -{ SiSU @ Wikipedia }http://en.wikipedia.org/wiki/SiSU -{ SiSU @ Freshmeat }http://freshmeat.net/projects/sisu/ -{ SiSU @ Ruby Application Archive }http://raa.ruby-lang.org/project/sisu/ -{ SiSU @ Debian }http://packages.qa.debian.org/s/sisu.html -{ SiSU Download }http://www.jus.uio.no/sisu/SiSU/download.html -{ SiSU Changelog }http://www.jus.uio.no/sisu/SiSU/changelog.html -{ SiSU help }http://www.jus.uio.no/sisu/sisu_manual/sisu_help/ -{ SiSU help sources }http://www.jus.uio.no/sisu/sisu_manual/sisu_help_sources/ - -% @rcs:+ $Id$ - -:A~? @title @creator - -:B~? SiSU an attempt to describe - -1~ Description - -2~ Outline - -SiSU is a flexible document preparation, generation publishing and search system.~{ This information was first placed on the web 12 November 2002; with predating material taken from http://www.jus.uio.no/lm/lm.information/toc.html part of a site started and developed since 1993. See document metadata section http://www.jus.uio.no/sisu/SiSU/metadata.html for information on this version. Dates related to the development of SiSU are mostly contained within the Chronology section of this document, e.g. http://www.jus.uio.no/sisu/sisu_chronology }~ - -SiSU ("SiSU information Structuring Universe" or "Structured information, Serialized Units"),~{ also chosen for the meaning of the Finnish term "sisu". }~ is a Unix command line oriented framework for document structuring, publishing and search. Featuring minimalistic markup, multiple standard outputs, a common citation system, and granular search. - -Using markup applied to a document, SiSU can produce plain text, HTML, XHTML, XML, OpenDocument, LaTeX or PDF files, and populate an SQL database with objects~{ objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. }~ (equating generally to paragraph-sized chunks) so searches may be performed and matches returned with that degree of granularity (e.g. your search criteria is met by these documents and at these locations within each document). Document output formats share a common object numbering system for locating content. This is particularly suitable for "published" works (finalized texts as opposed to works that are frequently changed or updated) for which it provides a fixed means of reference of content. - -SiSU is the data/information structuring and transforming tool, that has resulted from work on one of the oldest law web projects. It makes possible the one time, simple human readable markup of documents, that SiSU can then publish in various forms, suitable for paper~{ pdf via LaTeX or lout }~, web~{ currently html (two forms of html presentation one based on css the other on tables), and /PHP/; potentially structured XML }~ and relational database~{ any SQL - currently PostgreSQL and /sqlite/ (for portability, testing and development) }~ presentations, retaining common data-structure and meta-information across the output/presentation formats. Several requirements of legal and scholarly publication on the web have been addressed, including the age old need to be able to reliably cite/pinpoint text within a document, to easily make footnotes/endnotes, to allow for semantic document meta-tagging, and to keep required markup to a minimum. These and other features of interest are listed and described below. A few points are worth making early (and will be repeated a number of times): - -_1 (i) The SiSU document generator was the first to place material on the web with a system that makes possible citation across different document types, with paragraph, or rather object citation numbering~{ previously called "text object numbering" }~ a text positioning system, available for the pinpointing of text, 1997, a simple idea from which much benefit, and SiSU remains today, to the best of my knowledge, the only multiple format e-book/ electronic-document system on the web that gives you this possibility (including for relational databases). - -_1 (ii) Markup is done once for the multiple formats produced. - -_1 (iii) Markup is simple, and human readable (with a little practice), in almost all cases there is less and simpler markup required than basic html. In any event the markup required is very much simpler than the html, LaTeX, [lout], structured XML, ODF (OpenDocument), PostgreSQL or SQLite feed etc. that you can have SiSU generate for you. - -_1 (iv) SiSU is a batch processor, dealing with as many files as you need to generate at a time. - -_1 (v) Scalability is dependent on your file system (in my case Reiserfs), the database (currently Postgresql and/or SQLite) and your hardware. - -SiSU Sabaki~{ SiSU Sabaki, release version. Pre-release version SiSU Scribe, and version prior to that SiSU nicknamed Scribbler. Pre-release versions go back several years. Both Scribbler and Scribe (still maintained) made system calls to SiSU's various parts, instead of using libraries. }~ (or just SiSU) is the provisional name given to the software described here that helps structure documents for web and other publication. The name SiSU is a loose anagram for something along the lines of *{/{"SiSU is structuring unit"}/}*, or /{"SiSU, information structuring unit"}/ or the more descriptive /{"Structured information, Serialized Units"}/ or *{/{"simple - information structuring unit"}/}* or the more descriptive /{"Structured information, Serialized Units"}/ or what it may be directed towards /{"*semantic* and *{information structuring universe}*"}/,~{ A little universe it may be, but semantic you may have a hard time getting away with, given the meaning the word has taken on with markup. On a document wide basis semantic information may be provided, which can be really useful, (and meaningful, especially) if you have a large document set, and use this with rss feeds or in an sql database etc. On a markup level, I have little inclination to add semantic markup formally beyond references, title, author [Dublin Core entities? addresses?] etc. Actually this deserves a bit of thought possibly use letter tags (including letter alias/synonyms for font faces) to create a small set of default semantic tags, with the possibility for per document adjustments. Will seek to permit XML entity tagging, within SiSU markup and have that ignored/removed by the parts of the program that have no use for it. }~ tongue in cheek, only just. Guess I'll get away with *{/{"Simple - information Structuring Universe"}/}*. SiSU is also a Finnish word roughly meaning guts, inner strength and perseverance.~{ "Sisu refers not to the courage of optimism, but to a concept of life that says, 'I may not win, but I will gladly give my life for what I believe.'" Aini Rajanen, Of Finnish Ways, 1981, p. 10.
http://www.humanlanguages.com/finnishenglish/rlfs.htm
"Every Finn has his own pet definition. To me, sisu means patience without passion. But there are many varieties of sisu. Sisu can be a sudden outburst or it can be the kind that lasts. A man can have both kinds. It is outside reason. It is something in the soul. It comes from oneself. For instance, it makes a soldier do things because he himself must, not because he has been told." Paavo Nurmi
http://personalweb.smcvt.edu/tmatikainen/finnishtraditions.htm }~ - -SiSU was born of the need to find a way, with minimal effort, and for as wide a range of document types as possible, to produce high quality publishing output in a variety of document formats. As such it was necessary to find a simple document representation that would work across a large number of document types, and the most convenient way(s) to produce acceptable output formats. The project leading to this program was started in 1993 (together with the trade law project now known as Lex Mercatoria) as an investigation of how to effectively/efficiently place documents on the web. The unified document handling, together with features such as paragraph numbering, endnote handling and tables... appeared in 1996/97. SiSU was originally written in Perl,~{ http://www.perl.org/ }~ and converted to Ruby,~{ http://www.ruby-lang.org/en/ }~ in 2000, one of the most impressive programming languages in existence! In its current form it has been written to run on the Gnu/Linux platform, and in particular on Debian,~{ http://www.debian.org/ }~ taking advantage of many of the wonderful projects that are available there. - -SiSU markup is based on requiring the minimum markup needed to determine the structure of a document. (This can be as little as saying in a header to look for the word Book at a specified level and the word Chapter at another level). SiSU then breaks a document into its smallest parts (at a heading, and paragraph level) while retaining all structural information. This break up of the document and information on its structure is taken advantage of in the transformations made in generating the very different output types that can be created, and in providing as much as can be for what each output type is best at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), ODF (OpenDocument [experimental]), SQL (e.g. document search; representing constituent parts of documents based on their structure, headings, chapters, paragraphs as required; user control).~{ where explicit structure is provided through the use of tagging headings, it could be reduced (still) further, for example by reducing the number of characters used to identify heading levels; but in many cases even that information is not required as regular expressions can be used to extract the implicit structure. }~ - -From markup that is simpler and more sparse than html you get: - -_* far greater output possibilities, including html, XML, ODF (OpenDocument), LaTeX (pdf), and SQL; - -_* the advantages implicit in the very different output possibilities; - -_* a common citation system (for all outputs - including the relational database, search results are relevant for all outputs); - -For more see the short summary of features provided below. - -SiSU processes files with minimal tagging to produce various document outputs including html, LaTeX or lout (which is converted to pdf) and if required loads the structured information into an SQL database (PostgreSQL and SQLite have been used for this). SiSU produces an intermediate processing format.~{ This proved to be the easiest way to develop syntax, changes could be made, or alternatives provided for the markup syntax whilst the intermediate markup syntax was largely held constant. There is actually an optional second intermediate markup format in YAML http://www.yaml.org/ }~ - -SiSU is used in constructing Lex Mercatoria http://lexmercatoria.org/ or http://www.jus.uio.no/lm/ (one of the oldest law web sites), and considerable thought went into producing output that would be suitable for legal and academic writings (that do not have formulae) given the limitations of html, and publication in a wide variety of "formats", in particular in relation to the convenient and accurate citation of text. However, the construction of Lex Mercatoria uses only a fraction of the features available from SiSU today, /vis/ generation of flat file structures, rather than in addition the building of ("granular") SQL database content, (at an object level with relevant relational tables, and other outputs also available). - -2~ Short summary of features *~summary - -!_ (i) -markup syntax: (a) simpler than html, (b) mnemonic, influenced by mail/messaging/wiki markup practices, (c) human readable, and easily writable, - -!_ (ii) -(a) minimal markup requirement, (b) single file marked up for multiple outputs, - -notes: - -* documents are prepared in a single UTF-8 file using a minimalistic mnemonic syntax. Typical literature, documents like "War and Peace" require almost no markup, and most of the headers are optional. - -* markup is easily readable/parsed by the human eye, (basic markup is simpler and more sparse than the most basic html), [this may also be converted to XML representations of the same input/source document]. - -* markup defines document structure (this may be done once in a header pattern-match description, or for heading levels individually); basic text attributes (bold, italics, underscore, strike-through etc.) as required; and semantic information related to the document (header information, extended beyond the Dublin core and easily further extended as required); the headers may also contain processing instructions. - -!_ (iii) -(a) multiple outputs primarily industry established and institutionally accepted open standard formats, include amongst others: plaintext (UTF-8); html; (structured) XML; ODF (Open Document text)l; LaTeX; PDF (via LaTeX); SQL type databases (currently PostgreSQL and SQLite). Also produces: concordance files; document content certificates (md5 or sha256 digests of headings, paragraphs, images etc.) and html manifests (and sitemaps of content). (b) takes advantage of the strengths implicit in these very different output types, (e.g. PDFs produced using typesetting of LaTeX, databases populated with documents at an individual object/paragraph level, making possible granular search (and related possibilities)) - -!_ (iv) -outputs share a common numbering system (dubbed "object citation numbering" (ocn)) that is meaningful (to man and machine) across various digital outputs whether paper, screen, or database oriented, (PDF, html, XML, sqlite, postgresql), this numbering system can be used to reference content. - -!_ (v) -SQL databases are populated at an object level (roughly headings, paragraphs, verse, tables) and become searchable with that degree of granularity, the output information provides the object/paragraph numbers which are relevant across all generated outputs; it is also possible to look at just the matching paragraphs of the documents in the database; [output indexing also work well with search indexing tools like hyperesteier]. - -!_ (vi) -use of semantic meta-tags in headers permit the addition of semantic information on documents, (the available fields are easily extended) - -!_ (vii) -creates organised directory/file structure for (file-system) output, easily mapped with its clearly defined structure, with all text objects numbered, you know in advance where in each document output type, a bit of text will be found (e.g. from an SQL search, you know where to go to find the prepared html output or PDF etc.)... there is more; easy directory management and document associations, the document preparation (sub-)directory may be used to determine output (sub-)directory, the skin used, and the SQL database used, - -!_ (viii) -"Concordance file" wordmap, consisting of all the words in a document and their (text/ object) locations within the text, (and the possibility of adding vocabularies), - -!_ (ix) -document content certification and comparison considerations: (a) the document and each object within it stamped with an md5 hash making it possible to easily check or guarantee that the substantive content of a document is unchanged, (b)version control, documents integrated with time based source control system, default RCS or CVS with use of $Id: sisu_description.sst,v 1.25 2007/08/23 12:22:36 ralph Exp $ tag, which SiSU checks - -!_ (x) -SiSU's minimalist markup makes for meaningful "diffing" of the substantive content of markup-files, - -!_ (xi) -easily skinnable, document appearance on a project/site wide, directory wide, or document instance level easily controlled/changed, - -!_ (xii) -in many cases a regular expression may be used (once in the document header) to define all or part of a documents structure obviating or reducing the need to provide structural markup within the document, - -!_ (xiii) -prepared files may be batch process, documents produced are static files so this needs to be done only once but may be repeated for various reasons as desired (updated content, addition of new output formats, updated technology document presentations/representations) - -!_ (xiv) -possible to pre-process, which permits: the easy creation of standard form documents, and templates/term-sheets, or; building of composite documents (master documents) from other sisu marked up documents, or marked up parts, i.e. import documents or parts of text into a main document should this be desired - -there is a considerable degree of future-proofing, output representations are "upgradeable", and new document formats may be added. - -!_ (xv) -there is a considerable degree of future-proofing, output representations are "upgradeable", and new document formats may be added: (a) modular, (thanks in no small part to Ruby) another output format required, write another module.... (b) easy to update output formats (eg html, XHTML, LaTeX/PDF produced can be updated in program and run against whole document set), (c) easy to add, modify, or have alternative syntax rules for input, should you need to, - -!_ (xvi) -scalability, dependent on your file-system (ext3, Reiserfs, XFS, whatever) and on the relational database used (currently Postgresql and SQLite), and your hardware, - -!_ (xvii) -only marked up files need be backed up, to secure the larger document set produced, - -!_ (xviii) -document management, - -!_ (xix) -Syntax highlighting for SiSU markup is available for a number of text editors. - -!_ (xx) -remote operations: (a) run SiSU on a remote server, (having prepared sisu markup documents locally or on that server, i.e. this solution where sisu is installed on the remote server, would work whatever type of machine you chose to prepare your markup documents on), (b) generated document outputs may be posted by sisu to remote sites (using rsync/scp) (c)document source (plaintext utf-8) if shared on the net may be identified by its url and processed locally to produce the different document outputs. - -!_ (xxi) -document source may be bundled together (automatically) with associated documents (multiple language versions or master document with inclusions) and images and sent as a zip file called a sisupod, if shared on the net these too may be processed locally to produce the desired document outputs, these may be downloaded, shared as email attachments, or processed by running sisu against them, either using a url or the filename. - -!_ (xxii) -for basic document generation, the only software dependency is Ruby, and a few standard Unix tools (this covers plaintext, html, XML, ODF, LaTeX). To use a database you of course need that, and to convert the LaTeX generated to PDF, a LaTeX processor like tetex or texlive. - -as a developers tool it is flexible and extensible - -SiSU was developed in relation to legal documents, and is strong across a wide variety of texts (law, literature...). SiSU handles images but is not suitable for formulae/ statistics, or for technical writing at this time. - -SiSU has been developed and has been in use for several years. Requirements to cover a wide range of documents within its use domain have been explored. - -Some modules are more mature than others, the most mature being Html and LaTeX / pdf. PostgreSQL and search functions are useable and together with /ocn/ unique (to the best of my knowledge). The XML output document set is "well formed" but largely proof of concept. - -2~ How it works - -SiSU markup is fairly minimalistic, it consists of: a (largely optional) document header, made up of information about the document (such as when it was published, who authored it, and granting what rights) and any processing instructions; and markup within text which is related to document structure and typeface. SiSU must be able to discern the structure of a document, (text headings and their levels in relation to each other), either from information provided in the instruction header or from markup within the text (or from a combination of both). Processing is done against an abstraction of the document comprising of information on the document's structure and its objects,~{ objects include: headings, paragraphs, verse, tables, images, but not footnotes/endnotes which are numbered separately and tied to the object from which they are referenced. }~ which the program serializes (providing the object numbers) and which are assigned hash sum values based on their content. This abstraction of information about document structure, objects, (and hash sums), provides considerable flexibility in representing documents different ways and for different purposes (e.g. search, document layout, publishing, content certification, concordance etc.), and makes it possible to take advantage of some of the strengths of established ways of representing documents, (or indeed to create new ones). - -2~ Simple markup - -SiSU markup is based on requiring the minimum markup needed to determine the structure of a document. (This can be as little as saying in a header to look for the word Book at a specified level and the word Chapter at another level). SiSU then breaks a document into its smallest parts (at a heading, and paragraph level) while retaining all structural information. This break up of the document and information on its structure is taken advantage of in the transformations made in generating the very different output types that can be created, and in providing as much as can be for what each output type is best at doing, e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), ODF (OpenDocument), SQL (e.g. document search; representing constituent parts of documents based on their structure, headings, chapters, paragraphs as required; user control).~{ where explicit structure is provided through the use of tagging headings, it could be reduced (still) further, for example by reducing the number of characters used to identify heading levels; but in many cases even that information is not required as regular expressions can be used to extract the implicit structure. }~ - -3~ Sparse markup requirement, try to get the most out of markup - -One of its strengths is that very small amounts of initial tagging is required for the program to generate its output. - -This is a basic markup example: - -_* { basic markup example, text file - an international convention }http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst ~{ http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst output provided as example in the next section }~ - -_* { view basic markup, as it would be highlighted by vim editor }http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html ~{ http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html as it would appear with syntax highlighting (by vim) }~ - -Emphasis has been on simplicity and minimalism in markup requirements. Design philosophy is to try keep the amount of markup required low, for whatever has been determined to be acceptable output.~{ seems there are several "smart ASCIIs" available, primarily for ascii to html conversion, that make this, and reasonable looking ascii their goal
http://webseitz.fluxent.com/wiki/SmartAscii
http://daringfireball.net/projects/markdown/
http://www.textism.com/tools/textile/ }~ - -SiSU's markup is more minimalistic and simpler than (the equivalent) html and for it, you get considerably more than just html, as this preparation gives you all available output formats, upon request. - -3~ Single markup file provides multiple output formats - -For each document, there is only one (input, minimalistically marked up) file from which all the available output types are generated.~{ These include richly laid out and linked html (table or css variants), /PHP/, LaTeX (from which pdf portrait and landscape documents are produced), texinfo (for info files etc.), and PostgreSQL and/or SQLite. And the opportunity to fairly easily build additional modules, such as XML. See the examples provided in this document. }~ - -Eg. the markup example: - -_* {~^ original text file - an international convention }http://www.jus.uio.no/sisu/sample/markup/un_contracts_international_sale_of_goods_convention_1980.sst - -_* {~^ view as syntax would be highlighted by vim editor }http://www.jus.uio.no/sisu/sample/syntax/un_contracts_international_sale_of_goods_convention_1980.sst.html - -Produces the following output: - -_* {~^ Segmented html version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/toc.html - -_* {~^ Full length html document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/doc.html - -_* {~^ pdf landscape version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/landscape.pdf - -_* {~^ pdf portrait version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/portrait.pdf - -_* {~^ clean tex ascii version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/plain.txt - -_* {~^ /xml/ sax version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/sax.xml - -_* {~^ /xml/ dom version of document }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/dom.xml - -_* {~^ Concordance }http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980/concordance.html - -(and in addition to these: PostgreSQL, SQLite, texinfo and -{YAML}- ~{ discontinued for the time being }~ versions if desired) - -3~ Syntax relatively easy to read and remember - -Syntax is kept simple and mnemonic.~{ SiSU markup syntax, an incomplete summary: http://www.jus.uio.no/sisu/sisu_markup_table/doc.html#h200306
Visual check of elementary font face modifiers: *bold* *{bold}* !{emphasis}! /{italics}/ _{underscore}_ -{strikethrough}- ^{superscript}^ ,{subscript}, }~ - -3~ Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types - -To keep SiSU markup sparse and simple SiSU deliberately provides a limited publishing feature set, including: indent levels; bold; italics; superscript; subscript; simple tables; images; tables of contents and; endnotes. Which in most cases are available across the different output formats. - -The publishing feature set may be expanded as required. - -2~ Designed with usability in mind - -Output is designed to be uniform, easy to read, navigate and cite. - -2~ Code separate from content - -Code~{ the program that generates the documents }~ is separated from content. This means that when changes are desired in the output presentation, the code that produces them, and not the marked up text data set (which could be thousands of documents) is modified. Separating code from content makes large scale changes to output appearance trivial, and permits the easy addition of new output modules. - -2~ Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine *~citation *~ocn - -Object citation numbering is a simple object (text) positioning and cition system that is human relevant and machine useable, used by SiSU for all manner of presentations, and that is available for use in all text mappings. It is based on the automated sequential numbering of objects (roughly paragraphs, (headings, tables, verse) or other blocks of text or images etc.). The text positioning system (in which I claim copyright) is invaluable for publishing requiring the citing text across multiple output formats, and for the general mapping of text within a document: - -_* in html, html not being easily citeable (change font size, or use a different browser and the page on which specific text appears has changed), and - -_* across multiple formats being common to all output formats html/xml/pdf/sql output, - -_* the results of an sql search can just be "live" citation references to the documents in which the text is found, {~^ much like an index (see image examples provided). }http://www.jus.uio.no/sisu/SiSU/1.html#search - -I claim copyright on the system I use which is the most basic of all, numbering all text in headings and paragraphs sequentially (with tables and images being treated as a single paragraph) and only footnotes/endnotes not following this numbering, as their position in text is not strictly determined, (a change from footnotes to endnotes would change their numbering), footnotes instead "belong" to the paragraph from which they are referenced, and have sequential numbers of their own. - -SiSU has a paragraph numbering system, that remains the same regardless of the output format. This provides an effective means of citation, pinpointing text accurately in all output formats, using the same reference. This is particularly useful where text has to be located across different output formats - for example once html is printed the number of pages and pages on which given text is found will vary depending on the browser, its settings the font size setting etc. Similarly SiSU produces pdf in different forms, eg. on the example site Lex Mercatoria as portrait and landscape documents - here too page numbering varies, but paragraph numbering is the same, /{vis a vis}/ all versions of the text (portrait and landscape pdf and the html versions of the text, and as stored (with "paragraphs" as records) to the PostgreSQL or SQLite database). - -These numbers are placed in the text margins and are intended to be independent of and not to interfere with authors tagging. [The citation system (object citation numbering system, automated "paragraph numbering") which is automatically generated and is common and identical across all document formats] The paragraph numbering system is more accurately described as an (text) object numbering system, as headings are also numbered... all headings and paragraphs are numbered sequentially. Endnotes are automatically numbered independently and rather "belong" to the paragraph from which they are referenced, as an endnote does not (necessarily) form a part of a documents sequence, (they may be produced as either endnotes or footnotes (or both depending on what output you choose to look at - if you take the segmented html version document provided as an example, you will find that the endnotes are placed both at the end of each section, and in a separate section of their own called endnotes, and these are hyper-linked)). An attractive feature of providing citation numbering in this way is that it is independent of the document structure... it remains the same regardless of what is done about the document structure. - -The rules have been kept very simple, unique incremental object citation numbers are assigned to headings, paragraphs, verse, tables and images. It is possible to manually override this feature on a per heading or comment basis though this should be used exceptionally, it may be of use where there a substantive text, and the addition of a minor comment by the publisher that should not be mapped as part of the text. - -The object citation number markers contain additional numbering information with regard to the document structure, that can be used for alternative presentations, including such detail as the type of object (heading, paragraph, table, image, etc.), numbered sequentially. - -An advantage is that the numbering remains the same regardless of document structure. - -Text object ("paragraph") numbering is the same for all output versions of the same document, vis html, pdf, pgsql, yaml etc. - -In the relational database, as individual text objects of a document stored (and indexed) together with object numbers, and all versions of the document have the same numbering, the results of searches may be tailored just to provide the location of the search result in all available document formats. - -/{ Note: there is a bug in the released behaviour of object citation numbering, (not certain when it was introduced) tables should be numbered, ie each table gets an ocn, required amongst other things for relational database. This will be corrected in a future release. Citation numbering of existing documents that contain tables will changed. }/ - -2~ Handling of Dublin Core meta-tags making use of the Resource Description Framework - -SiSU is able to use meta tags based on the Dublin Core~{ http://dublincore.org/ }~ and Resource Description Framework~{ http://www.w3.org/RDF/ }~ - -This provides the means of providing semantic information about a document, both as computer processable meta-tags, and as human readable information that may be of value for classification purposes. - -This information is provided both in html metatags, and (where available) under the section titled "Document Information - MetaData", near the end of a document, for example in the segmented html version of this text at: http://www.jus.uio.no/sisu/SiSU/metadata.html - -2~ Easy directory management - -#1 Directory file association, skins and special image management, made simpler.~{ The previous way was directory associations for file output were set up in the configuration file. The present system is a more natural way to work requireing less configuration. }~ - -The last part of the name of the work directory in which markup is being done, or rather from where SiSU is run in order to generate document output, is used in determining the sub-directory name for output files, that is created in the document output directory. This provides a rather easy way to associate documents e.g. of a given subject, or by owner. - -code{ - -/www/docs - /intellectual_property - /arbitration - /contract_law - -/www/docs - /ralph - /sisu - -}code - -all are placed in their own directories within the directory structure created. Similar rules are used in the creation of sql type databases (though they can be overridden). - -There are a couple of further associations with these directories. - -Directory wide skins. - -Directory specific images. - -# If there is a "directory skin", that is a skin of the same name as the directory, it is used in the generation of the documents within it, rather than the default skin, unless the document has a specific skin associated with it. - -_# default skin (always available) - -_# directory skin (precedence over default if exists) - -_# document skin (takes precedence wherever document requests a specific skin) - -Skins are defined in the document skin directory and if a directory association is desired a softlink made to the relevant skin. Skins (directory association auto load) auto load skin if a directory skin exists of same name as directory stub, (and there is no specific doc skin) - -# If the working directory has within it a sub-directory called image_local, the images within that directory are used for references to images, that are not part of the default site build. - -2~ Document Version Control Information - -The possibility of citing an exact document version. - -Permits the inclusion of document version control information to the document body and metatags.~{ from a version control system such as CVS }~ This provides a much more certain method of referring to the exact version of a particular document, (assuming that the document is from a trusted source, that will retain earlier versions of a document).~{ The version control system must be run, so the version number is obtained, prior to the SiSU document generation, and subsequent posting of the document. }~ - -This information (where available) is provided under the section of the document titled "Document Information - MetaData", near the end of a document, for example in the segmented html version of this text at: http://www.jus.uio.no/sisu/SiSU/metadata.html - -2~ Table of contents - -SiSU produces a rudimentary a table of contents based on document headings. - -2~ Auto-numbering of headings - -Headings can be automatically numbered, (and automatically named for hyper-linking) - -2~ Numbering and cross-hyperlinking of endnotes - -SiSU can automatically number footnotes/endnotes. This is the default operation where no number is provided. - -Footnotes/endnotes may also be manually numbered. Where a number, or numbers are provided for a footnote/endnote, this does not increment the automatic footnote/endnote number counter. - -In the html output footnotes/endnotes are cross-hyper-linked (to their reference point and vice versa). In th pdf output footnotes are linked from their reference point only. - -2~ "Skinnable" - -SiSU is skinnable, on a site-wide, directory-wide and per document basis, so different looking versions of things may be produced with little difficulty. There is a default skin which may be modified, as the background site skin, and each working directory may have a skin associated with it, as may each individual document. The hierarchy of application is document, directory, then site... ie if a document skin exists it gets precedence. - -Whilst it is skinnable, the default output styles are selected to work across the widest possible range of document types. - -2~ Multiple Outputs - -From markup that is simpler and more sparse than html you get: - -_* far greater output possibilities, including multiple html types, XML (different structured types), LaTeX (pdf landscape, portrait), and SQL (Postgresql or SQLite or other); - -_* the advantages implicit in these very different output possibilities;~{ e.g. LaTeX (professional document typesetting, easy conversion to pdf or Postscript), XML (in this case, structural representation), SQL (e.g. document set searches; representation of the constituent parts of documents based on their structure, headings, chapters, paragraphs as desired; control of use) }~ - -_* a common citation system - -As many output formats/presentations as one cares to write modules for - several types of html (e.g. structure based on css, or structure based on tables); /{LaTeX/pdf}/ and /{Lout/pdf}/; pgsql other databases easily added; yaml... - -3~ html - several presentations: full length & segmented; css & table based - -Most documents are produced in single and segmented html versions, described below: - -!_ The Scroll (full length text presentations) - -The full length of the text in a single scrollable document.~{ CISG http://www.jus.uio.no/lm/un_contracts_international_sale_of_goods_convention_1980/doc
The Unidroit Contract Principles http://www.jus.uio.no/lm/unidroit.contract.principles.1994/doc or
The Autonomous Contract http://www.jus.uio.no/lm/autonomous.contract.2000.amissah/doc }~ As a rule the files they are saved in are named: /doc/ or more precisely /{doc.html}/ - -For various reasons texts may only be provided in this form (such as this one which is short), though most are also provided as segmented texts. - -"Scroll" is a reference to the historical scroll, a single long document/ parchment, and also no doubt to what you will have to do to get to the bottom of the text.~{ Scrolling is not however necessarily confined to full length documents as you will have to scroll to get to the bottom of any long segment (eg. chapter) of a segmented text. }~ - -!_ The Segmented Text - -The text divided into segments (such as articles or chapters depending on the text)~{ CISG http://www.jus.uio.no/sisu/un_contracts_international_sale_of_goods_convention_1980
The Unidroit Principles http://www.jus.uio.no/lm/unidroit.contract.principles.1994
The Autonomous Contract http://www.jus.uio.no/sisu/the.autonomous.contract.2000.amissah or
WTA 1994 http://www.jus.uio.no/lm/wta.1994 }~ As a rule the files they are saved in are named: /toc/ and /index/ or more precisely /{toc.html}/ and /{index.html}/ - -If you know exactly what you are looking for, loading a segment of text is faster (the segments being smaller). Occasionally longer documents such as the WTA 1994 http://www.jus.uio.no/lm/wta.1994/toc are only provided in segmented form. - -!_ Cascading Style Sheet, and Table based html - -SiSU outputs html, two current standard forms available are: - -{ css based }http://www.jus.uio.no/sisu/SiSU/toc.html - -and - -table based [largely discontinued]~{ formatting possibility still exists in code tree but maintenance has been largely discontinuted. }~ - -!_ The html is tested across several browsers - -I like to remind you that there are other excellent browsers out there, many of which have long supported practical features like tabbing. - -The html is tested across several browsers, including: - -_* {~^ *Firefox* (Mozilla-Firefox) }http://www.mozilla.org/products/firefox/ - -_* {~^ Kazehakase }http://kazehakase.sourceforge.jp/ - -_* {~^ Konqueror }http://www.konqueror.org/ - -_* {~^ Mozilla }http://www.mozilla.org/ - -_* {~^ MS Internet Explorer }http://www.microsoft.com/windows/ie/default.asp - -_* {~^ Netscape }http://home.netscape.com/comprod/mirror/client_download.html - -_* {~^ Opera }http://www.opera.com/ - -Also lighter weight graphical browsers: - -_* {~^ Dillo }http://www.dillo.org/ - -_* {~^ *Epiphany* }http://www.gnome.org/projects/epiphany/ - -_* {~^ *Galeon* }http://galeon.sourceforge.net/ - -And for console/text browsing: - -_* {~^ *elinks* }http://elinks.or.cz/ - -_* {~^ *links2* }http://links.twibright.com/ - -_* {~^ *w3m* }http://w3m.sourceforge.net/ - -The html tables output is rendered more accurately across a wider variety set and older versions of browsers (than the html css output). - -3~ XML - -SiSU generates well formed XML, and multiple versions. An XML SAX version with a flat/shallow structure, and XML DOM version with a deeper (embedded) structure. There is also a released working xhtml module. Examples of SAX and DOM versions are provided within this document. - -3~ ODT:ODF, Open Document Format - ISO/IEC 26300:2006 - -SiSU generates Open Document Output format. - -3~ PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) - -SiSU outputs LaTeX if required which is easily transformed to PDF.~{ LaTeX and pdf features introduced 18^th^ June 2001, Landscape and portrait pdfs introduced 7^th^ October 2001., Lout is a more recent addition 22^th^ April 2003 }~ PDF documents are generated on the site from the same source files and Ruby program that produce html. Landscape oriented pdf introduced, providing easier screen viewing, they are also (paper saving, being currently) formatted to have fewer pages than their portrait equivalents. - -_* {~^ Adobe Reader }http://www.adobe.com/products/acrobat/readstep2.html - -_* {~^ *Evince* }http://www.gnome.org/projects/evince/ - -_* {~^ xpdf }http://www.foolabs.com/xpdf/ - -3~ Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) - -SiSU (from the same markup input file) automatically feeds into PostgreSQL~{ http://www.postgresql.org/
http://advocacy.postgresql.org/
http://en.wikipedia.org/wiki/Postgresql }~ and/or SQLite~{ http://www.hwaci.com/sw/sqlite/
http://en.wikipedia.org/wiki/Sqlite }~ database (could be any other of the better relational databases)~{ Relational database features retaining document structure and citation introduced 15^th^ July 2002 }~ - together with all additional information related to document structure, and the alternative ways in which it is generated on the site retained. As regards scaling of the database, it is as scalable as the database (here Postgresql or SQLite) and hardware allow. I will prune the images later. - -This is one of the more interesting output forms, as all the structural data for the documents are retained (though can be ignored by the user of the database should they so choose). All site texts/documents are (currently) streamed to four pgsql database tables: - -_1* one containing semantic (and other) headers, including, title, author, subject, (the Dublin Core...); - -_1* another the substantive texts by individual "paragraph" (or object) - along with structural information, each paragraph being identifiable by its paragraph number (if it has one which almost all of them do), and the substantive text of each paragraph quite naturally being searchable (both in formatted and clean text versions for searching); and - -_1* a third containing endnotes cross-referenced back to the paragraph from which they are referenced (both in formatted and clean text versions for searching). - -_1* a fourth table with a one to one relation with the headers table contains full text versions of output, eg. pdf, html, xml, and ascii. - -There is of course the possibility to add further structures. - -At this level SiSU loads a relational database with documents broken in to their smallest logical structurally constituent parts, as text objects, with their object citation number and all other structural information needed to construct the structured document. Text is stored (at this text object level) with and without elementary markup tagging, the stripped version being so as to facilitate ease of searching. - -Because the document structure of sites created is clearly defined, and the text object citation system is available for all forms of output, it is possible to search the sql database, and either read results from that database, or just as simply map the results to the html output, which has richer text markup. - -The combination of the SiSU citation system with a relational database is pretty powerful, giving rise to several possibilities. As individual text objects of a document stored (and indexed) together with object numbers, and all versions of the document have the same numbering, complex searches can be tailored to return just the locations of the search results relevant for all available output formats, with live links to the precise locations in the database or in html/xml documents; or, the structural information provided makes it possible to search the full contents of the database and have headings in which search content appears, or to search only headings etc. (as the Dublin Core is incorporated it is easy to make use of that as well). - -This is a larger scale project, (with little development on the front end largely ignored), though the "infrastructure" has been in place since 2002. - -3~ Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) *~search - -{~^ Sample search frontend }http://search.sisudoc.org -A small database and sample query front-end (search from) that makes use of the citation system, _{object citation numbering}_ to demonstrates functionality.~{ (which could be extended further with current back-end). As regards scaling of the database, it is as scalable as the database (here Postgresql) and hardware allow. }~ - -SiSU can provide information on which documents are matched and at what locations within each document the matches are found. These results are relevant across all outputs using object citation numbering, which includes html, XML, LaTeX, PDF and indeed the SQL database. You can then refer to one of the other outputs or in the SQL database expand the text within the matched objects (paragraphs) in the documents matched. - -(further work needs to be done on the sample search form, which is rudimentary and only passes simple booleans correctly at present to the SQL engine) - -A few canned searches, showing object numbers. Search for: - -{ English documents matching Linux OR Debian }http://search.sisudoc.org?s1=Linux%2BOR%2BDebian&lang=En&db=SiSU_sisu&view=index&a=1 - -{ GPL OR Richard Stallman }http://search.sisudoc.org?s1=GPL%2BOR%2BRichard%2BStallman&lang=En&db=SiSU_sisu&view=index&a=1 - -{ invention OR innovation in English language }http://search.sisudoc.org?s1=invention%2BOR%2Binnovation&lang=En&db=SiSU_sisu&view=index&a=1 - -{ copyright in English language documents }http://search.sisudoc.org?s1=copyright&lang=En&db=SiSU_sisu&view=index&a=1 - -Note that the searches done in this form are case sensitive. - -Expand those same searches, showing the matching text in each document: - -{ English documents matching Linux OR Debian }http://search.sisudoc.org?s1=Linux%2BOR%2BDebian&lang=En&db=SiSU_sisu&view=text&a=1 - -{ GPL OR Richard Stallman }http://search.sisudoc.org?s1=GPL%2BOR%2BRichard%2BStallman&lang=En&db=SiSU_sisu&view=text&a=1 - -{ invention OR innovation in English language }http://search.sisudoc.org?s1=invention%2BOR%2Binnovation&lang=En&db=SiSU_sisu&view=text&a=1 - -{ copyright in English language documents }http://search.sisudoc.org?s1=copyright&lang=En&db=SiSU_sisu&view=text&a=1 - -Note you may set results either for documents matched and object number locations within each matched document meeting the search criteria; or display the names of the documents matched along with the objects (paragraphs) that meet the search criteria.~{ of this feature when demonstrated to an IBM software innovations evaluator in 2004 he said to paraphrase: this could be of interest to us. We have large document management systems, you can search hundreds of thousands of documents and we can tell you which documents meet your search criteria, but there is no way we can tell you without opening each document where within each your matches are found. }~ - -!_ OCN index mode, -(object citation number) the numbers displayed are relevant (and may be used to reference the match) in any sisu generated rendition of the text~{ OCN are provided for HTML, XML, pdf ... though currently omitted in plain-text and opendocument format output }~ the links provided are to the locations of matches within the html generated by SiSU. - -!_ Paragraph mode, -you may alternatively display the text of each paragraph in which the match was made, again the object/paragraph numbers are relevant to any SiSU generated/published text. - -Several options for output - select database to search, show results in index view (links to locations within text), show results with text, echo search in form, show what was searched, create and show a "canned url" for search, show available search fields. Also shows counters number of documents in which found and number of locations within documents where found. [could consider sorting by document with most occurrences of the search result]. - -Earlier version of the search frontend - Simple search, results with files in which search found, and locations where found within files. - -Simple search, results with files in which search found, and text object (paragraph or endnote) where found within files. - -3~ Other forms - -There are other forms as well, YAML file, Ruby Marshal dumps, document pre-processing (processing of documents prior to the steps described here, to produce input suitable for the program) snap in a new module as required/desired, well formed XML, no problem. - -2~ Concordance / Word Map or rudimentary index - -Concordance /WordMaps:~{ Concordance/ WordMaps introduced 15^th^ August 2002 }~ SiSU produces a rudimentary index based on the words within the text, making use of paragraph numbers to identify text locations. This is generated in html and hyper-linked but identifies these words locations in the other document formats. Though it is possible to search using a search engine, this is a means for browsing an alphabetical list of words which may suggest other useful content. - -% Concordance files may be built using a document vocabulary. The vocabulary to be used may be specified on a per document basis. - -2~ Managed (document) directory, database, or site structure - -SiSU builds the web site (or more generically provides a suitable directory structure) - placing various output texts in the hierarchy of the web-site (or db), which (for directories) is a sub-directory with the name of the text file. - -2~ Batch processing - -SiSU is a batch processing tool, handling and transforming multiple (or individual) documents (in many ways) with a single instruction. - -2~ Integration to superior Gnu/Linux and Unix tools - -As should have been noted by the above description of SiSU, it makes use of existing programs found on Gnu/Linux and Unix, amongst those already mentioned include the LaTeX to pdf converters and the database PostgreSQL or SQLite. - -3~ Backup and version control - -Unix provides many tools for version control. For documents Subversion, CVS and even the old RCS are useful for the per-document histories they provide. - -For writing code superior (more recent) version control system exist. These can also be used for documents though they tend to take stamps of changes across the repository as a whole, rather than for each individual file that is tracked, (as CVS and RCS do). My personal preference is for distributed systems such as Git, Mercurial or Darcs, of which I use Git for both code and documents. - -Several backup tools exist. At the base level I tend to use rdiff. - -3~ Editor support - -SiSU documents are prepared / marked up in utf-8 text _{you are free to use the text editor of your choice.}_ - -Syntax highlighting for a number of editors are provided. Amongst them Vim, Kwrite, Kate, Gedit and diakonos. These may be found with configuration instructions at http://www.jus.uio.no/sisu/syntax_highlight. {~^ Vim }http://www.vim.org/ as of version 7 has built in sytax highlighting for SiSU. - -2~ Modular design, need something new add a module - -Need a new output format that does not already exist, write a new module. - -Prefer a new input syntax, you could write a new syntax matching the existing design, though my personal preference is some uniformity in entry appearance. If necessary has been fairly easy to extend the design parameters. It is intended to incorporate some additional basic semantic tagging, (book, article, author etc.) However, keeping the requirements for input minimal, and relatively simple has been a design goal. - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_manifest.html b/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_manifest.html deleted file mode 100644 index ea1a588e..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/sisu_manifest.html +++ /dev/null @@ -1,197 +0,0 @@ - - - - -SiSU manifest: SiSU - - - - - - - - - - -

- - -

- -

SiSU - Description

Ralph Amissah

- -

SiSU manifest

- - - - - - - - - - - - - - -

description	filename	file size (kB)
table of contents (for segmented HTML text)	toc.html <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/toc.html>	19.9
full length document (HTML)	doc.html <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/doc.html>	187.7
full length document (PDF portrait / vertical - recommended for printing)	portrait.pdf <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/portrait.pdf>	214.1
full length document (PDF landscape / horizontal - recommended for screen viewing)	landscape.pdf <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/landscape.pdf>	209.7
full length document (ODF:ODT - Open Document Format)	opendocument.odt <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/opendocument.odt>	27.8
full length document (XHTML)	scroll.xhtml <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/scroll.xhtml>	90.3
full length document (XML SAX)	sax.xml <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sax.xml>	92.9
full length document (XML DOM)	dom.xml <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/dom.xml>	100.0
full length document (plaintext Unix (UTF-8) with footnotes)	plain.txt <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/plain.txt>	59.0
Concordance file (HTML - wordmap, alphabetical wordlist)	concordance.html <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/concordance.html>	322.0
Digest/DCC - Document Content Certificate (md5)	digest.txt <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/digest.txt>	31.2

- - -

Markup (SiSU source)	sisu_description.sst b89ccdad9f6d9c2260d8d383d6b35ccc <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sisu_description.sst>	53.4 -
SiSU doc (zip)	sisupod.zip 5e579282a37a5b125996e11b95c888ab <http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sisupod.zip>	20.1 -

SiSU manifest of document metadata

- - - - - - - - - - - - - - - - - - - - - - - -

metadata	description
DC Title:	SiSU - Description
Title:	SiSU
Subtitle:	Description
DC Creator:	Ralph Amissah
DC Publisher:	SiSU http://www.jus.uio.no/sisu (this copy)
DC Subject:	ebook, epublishing, electronic book, electronic publishing, electronic document, electronic citation, data structure, citation systems, search
DC Type:	information
DC Rights:	Copyright (C) Ralph Amissah 2007, part of SiSU documentation, License GPL 3
DC Date:	2007-08-30
DC Date created:	2002-11-12
DC Date issued:	2002-11-12
DC Date available:	2002-11-12
DC Date modified:	2007-08-30
DC Language:	English
DC Identifier:	http://www.jus.uio.no/sisu/sisu_manual/sisu_description/toc.html
Sourcefile:	sisu_description.sst
Word Count approximate:	7681
Sourcefile Digest (md5):	b89ccdad9f6d9c2260d8d383d6b35ccc
Document (metaverse) last generated:	Tue Sep 25 02:54:06 +0100 2007
Generated by:	SiSU 0.59.1 2007w39/2 (2007-09-25)
Ruby version:	ruby 1.8.6 (2007-06-07 patchlevel 36) [i486-linux]

- - - - - - - - - - - - -

metadata suggested links:

SiSU Manual

<http://www.jus.uio.no/sisu/sisu_manual/>

Book Samples and Markup Examples

<http://www.jus.uio.no/sisu/SiSU/2.html>

SiSU @ Wikipedia

<http://en.wikipedia.org/wiki/SiSU>

SiSU @ Freshmeat

<http://freshmeat.net/projects/sisu/>

SiSU @ Ruby Application Archive

<http://raa.ruby-lang.org/project/sisu/>

SiSU @ Debian

<http://packages.qa.debian.org/s/sisu.html>

SiSU Download

<http://www.jus.uio.no/sisu/SiSU/download.html>

SiSU Changelog

<http://www.jus.uio.no/sisu/SiSU/changelog.html>

SiSU help

<http://www.jus.uio.no/sisu/sisu_manual/sisu_help/>

SiSU help sources

<http://www.jus.uio.no/sisu/sisu_manual/sisu_help_sources/>

Document Language Versions, manifests

- - - -

filename	description

- - - - - - - - -

- -
- - - - - -	- - - Output generated by - - SiSU - - 0.59.1 2007-09-25 (2007w39/2) - - - SiSU - - Copyright ^© Ralph Amissah - 1997, current 2007. - All Rights Reserved. - - - SiSU - - is software for document structuring, publishing and search, - - - www.jus.uio.no/sisu - - and - - www.sisudoc.org - - - w3 since October 3 1993 - - ralph@amissah.com - - -	- - SiSU using: - Standard SiSU markup syntax, - Standard SiSU meta-markup syntax, and the - Standard SiSU object citation numbering and system, (object/text positioning system) - - Copyright ^© Ralph Amissah 1997, current 2007. - All Rights Reserved. - -
- - - - - -	- - - SiSU - - is released under - GPLv3 - or later, - <http://www.gnu.org/licenses/gpl.html> - -	- - SiSU, developed using - - Ruby - - on - - Debian/Gnu/Linux - - software infrastructure, - with the usual GPL (or OSS) suspects. - - Better - "performance, reliability, scalability, security & total cost of ownership" - [not to mention flexibility & choice] use of and adherence to open standards (where practical and fair) and it is software libre. - - Get With the Future - - Way Better! - - -

- - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/sisupod.zip b/data/doc/manuals_generated/sisu_manual/sisu_description/sisupod.zip deleted file mode 100644 index 060565dd..00000000 Binary files a/data/doc/manuals_generated/sisu_manual/sisu_description/sisupod.zip and /dev/null differ diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/sitemap.xml b/data/doc/manuals_generated/sisu_manual/sisu_description/sitemap.xml deleted file mode 100644 index c842adac..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/sitemap.xml +++ /dev/null @@ -1,30 +0,0 @@ - - - - - - http://www.jus.uio.no/sisu/sisu_manual/sisu_description/toc.html - 2007-08-30 - monthly - 0.7 - - - http://www.jus.uio.no/sisu/sisu_manual/sisu_description/doc.html - 2007-08-30 - 0.5 - - - http://www.jus.uio.no/sisu/sisu_manual/sisu_description/sisu_manifest.html - 2007-08-30 - 0.5 - - diff --git a/data/doc/manuals_generated/sisu_manual/sisu_description/toc.html b/data/doc/manuals_generated/sisu_manual/sisu_description/toc.html deleted file mode 100644 index dcdd4375..00000000 --- a/data/doc/manuals_generated/sisu_manual/sisu_description/toc.html +++ /dev/null @@ -1,704 +0,0 @@ - - - - - - SiSU - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- - - - - -

- -

- - - - - - - - - - - - - - - -

- -

toc - -

- -

- - - - -

- -

SiSU -

- -

Description -

- -

Ralph Amissah -

- -copy @ - - SiSU - - -

- -

- - SiSU - -
- Quick Ref.: -
- - Manifest - -
- - SiSU Manual - -
- - Book Samples and Markup Examples - -
- - SiSU @ Wikipedia - -
- - SiSU @ Freshmeat - -
- - SiSU @ Ruby Application Archive - -
- - SiSU @ Debian - -
- - SiSU Download - -
- - SiSU Changelog - -
- - SiSU help - -
- - SiSU help sources - -
- - SiSU electronic documents - -
- - www.jus.uio.no/sisu - -

- -

- SiSU - Description,
Ralph Amissah -

- -

- SiSU an attempt to describe -

- -

- - 1. Description - -

- -

- - 1.1 Outline - -

- -

- - 1.2 Short summary of features - -

- -

- - 1.3 How it works - -

- -

- - 1.4 Simple markup - -

- -

- - 1.4.4 Kept simple by having a limited publishing feature set, and features identified as most important, are available across several document types - -

- -

- - 1.5 Designed with usability in mind - -

- -

- - 1.6 Code separate from content - -

- -

- - 1.7 Object citation numbering, a text or object positioning / citation system - "paragraph" (or text object) numbering, that remains same and usable across all output formats by people and machine - -

- -

- - 1.14 "Skinnable" - -

- -

- - 1.15 Multiple Outputs - -

- -

- - 1.15.1 html - several presentations: full length & segmented; css & table based - -

- -

- - 1.15.2 XML - -

- -

- - 1.15.3 ODT:ODF, Open Document Format - ISO/IEC 26300:2006 - -

- -

- - 1.15.4 PDF - portrait and landscape, (through the generation of LaTeX output which is then transformed to pdf) - -

- -

- - 1.15.5 Search - loading/populating of relational database while retaining document structure information, object citation numbering and other features (currently PostgreSQL and/or SQLite) - -

- -

- - 1.15.6 Search - database frontend sample, utilising database and SiSU features, including object citation numbering (backend currently PostgreSQL) - -

- -

- - 1.15.7 Other forms - -

- -

- - Endnotes - -

- - - Document Information (metadata) - - -

- -

- - - - - -

- -

- - - - - - - - - - - - - - - -

- -

toc - -