Arabic PDFs - Revision history

Jessek: Minor cleanup, some editing

2009-03-12T13:42:49Z

Minor cleanup, some editing

Simsong: /* Glyphs vs. Characters */

2009-03-09T23:17:00Z

‎Glyphs vs. Characters

Simsong at 12:38, 8 March 2009

2009-03-08T12:38:46Z

Simsong at 15:41, 7 March 2009

2009-03-07T15:41:28Z

Simsong: New page: Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list....

2009-03-07T01:27:06Z

New page: Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list....

New page

Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.

An underlying cause for this error is the idea that there can be such a thing as a Character-Glyph model. However, in the real world there is no connection between abstract characters and the glyphs used to represent them.

Increasingly font designers are discovering the enormous conceptual freedom one gets without any Character-Glyph constraint. But Adobe still uses the Unicode standard to extract the nominal character values from the font glyph numbers used to represent them. That is why more advanced Arabic fonts that do not use the Unicode Presentation Blocks produce gibberish when text is extracted from the PDF.

Future versions of PDF are planned to embed Unicode as text in addition to the font information, which would resolve this issue.

Part of the problem is that Unicode’s Arabic Presentation Blocks are officially deprecated by the Unicode Consortium. Their inclusion was at the time – late 1980’s - a technical compromise to allow the ISO 10646 to join Unicode. As such the compromise was incomplete, as only 400 out of originally 4000 requested Arabic ligatures we allowed to remain in the Unicode Standard. Ironically, all the printed examples in the Unicode standard were designed by Thomas Milo based on computer-generated synthesis of the underlying letter block fusions of traditional Arabic "Script Grammar". This was done using DecoType’s famous ACE technology, that eventually became the working model for Microsoft’s True Type Open, the precursor of today's OpenType.

Arabic Presentation Forms should never be encoded, such a practice amounts to reverting to Font Pages, whose very proliferation caused the development of a more intelligent alternative: Unicode.

==References==
*http://www.river-valley.tv/conferences/arabic_typography_2008/
*http://www.river-valley.tv/conferences/non_latintypefacedesign/

@@ Line 1: / Line 1: @@
-This page discusses issues that arise when working with Adobe PDF files that contain Arabic.
+Documents in [[PDF]] format that contain Arabic text may present problems for examiners. This page presents the difference between a glyph and a character and how PDF documents can commingle them.
 ==Glyphs vs. Characters==
-The term ''chracter'' describes an abstract concept of a letter. The term ''glyph'' describes how a character prints. A single character can have multiple glyphs (for example, glyphs with serifs and those without). A single glyph can have multiple characters (for example, a lower case "l" and a capital "I" in Helvetica).
+The term ''chracter'' describes an abstract concept of a letter. The term ''glyph'' describes how a character prints. A single character can have multiple glyphs (for example, glyphs with serifs and those without). A single glyph can have multiple characters. For example, in the font Helvetica the same shape is used to represent a lower case 'l' (ell) and a capital 'I' (eye).
-PDFs can contain glyphs or characters.
+Unicode is set up as a catalog of nominal characters, independent and irrespective of the (computer) typographical consequences. For example, the English/US Unicode page has an entry for the character 'lower case a', but does not define how that letter should be displayed.
-Unicode is set up as a catalogue of nominal characters, independent and irrespective of the (computer) typographical consequences.
+PDF documents can contain both glyphs and characters. Modern PDFs emulate the 19th century-style metal-based typesetting process. Ideally PDFs should encode characters, not glyphs<sup>citation needed</sup>. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.
-−
-Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. Ideally PDFs should encode characters, not glyphs. But when typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.
 By interpreting the Unicode standard as a look-up for glyph indexes, Unicode is abused as if it were a huge font book. This confuses multi-lingual encoding with computer typography.

@@ Line 2: / Line 2: @@
 ==Glyphs vs. Characters==
-The term ''chracter'' describes an abstract concept of a letter. The term ''glyph'' describes how a character prints. A single character can have multiple glyphs (for example, glyphs with serifs and those without). A single glyph can have multiple characters (for example, a lower case ''l'' and a capital "I" in Helvetica).
+The term ''chracter'' describes an abstract concept of a letter. The term ''glyph'' describes how a character prints. A single character can have multiple glyphs (for example, glyphs with serifs and those without). A single glyph can have multiple characters (for example, a lower case "l" and a capital "I" in Helvetica).
 PDFs can contain glyphs or characters.

@@ Line 1: / Line 1: @@
-Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.
+This page discusses issues that arise when working with Adobe PDF files that contain Arabic.
-By interpreting the Unicode standard as a look-up for glyph indexes, Unicode is abused as if it were a huge font book. This confuses multi-lingual encoding with computer typography. Unicode is set up as a catalogue of nominal characters, independent and irrespective of the (computer) typographical consequences.
+==Glyphs vs. Characters==
 An underlying cause for this error is the idea that there can be such a thing as a Character-Glyph model. However, in the real world there is no connection between abstract characters and the glyphs used to represent them.

← Older revision		Revision as of 15:41, 7 March 2009
Line 1:		Line 1:
−	Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.	+	Modern PDFs essentially describe the result of a 19th century-style metal-based typesetting process. When typesetting Arabic, Unicode is used as a glyph list, rather than a character list. The glyphs are used as indexes into a huge font book.
		+
		+	By interpreting the Unicode standard as a look-up for glyph indexes, Unicode is abused as if it were a huge font book. This confuses multi-lingual encoding with computer typography. Unicode is set up as a catalogue of nominal characters, independent and irrespective of the (computer) typographical consequences.

	An underlying cause for this error is the idea that there can be such a thing as a Character-Glyph model. However, in the real world there is no connection between abstract characters and the glyphs used to represent them.		An underlying cause for this error is the idea that there can be such a thing as a Character-Glyph model. However, in the real world there is no connection between abstract characters and the glyphs used to represent them.