Encoding Standard (Web)

[36] Encoding は、 Web における文字符号化の扱いについて規定した仕様です。

仕様書

[35] Encoding (2012-04-28 01:17:54 +09:00 版) http://dvcs.w3.org/hg/encoding/raw-file/tip/Overview.html

概念

[79]

歴史

[99] 元々 Web における文字コード処理の原則は参照処理モデルとして緩やかに確立されていったのですが、その詳細が明確に標準化されているとは言い難い状態でした。

Web Encodings

[37] 当初 WHATWG Wiki の「Web Encodings」ページに annevk が Webブラウザーが実装する charset の名前の情報を集めていました。

またこの頃までに、公式な仕様と現実の Webブラウザーで文字符号化の実装が異なっており、例えば ISO-8859-1 は現実には Windows-1252 であることなどが認識され、 HTML Living Standard の規定に組み込まれていきました。

Encoding Standard

[38] 2011年12月、 annevk は文字符号化の名前に加えて、符号化と復号の調査と文書化も始めました。

[39] 仕様書は W3C の Mercurial リポジトリーで管理されていましたが、この時点では W3C の文書ではありませんでした。

[40] 2012年の春には TextEncoder/TextDecoder が提案されていますが、その参照実装において Encoding 仕様に基づく符号化と復号が実装されています。

[29] stringencoding - String encoding API for the Web - Google Project Hosting ( (2012-04-21 19:33:51 +09:00 版)) http://code.google.com/p/stringencoding/

[41] 2012年4月末には仕様書は完成に至ります。ただし Big5 については実装間の互換性に乏しく、実情も十分わかっていないということで、未確定の部分を残しています。

[34] 2012年4月26日には WHATCG の仕様となり、 CC0 から W3C CLA にライセンスが変更されました。また「Living Standard」から「Living Specification」に変わっています。

[42] annevk は今後の展望として、文字符号化の sniffing の規定も含めたいと述べています。

[43] Microsoft は自社の実装を変更するつもりはないと述べています。

[33] IRC logs: freenode / #whatwg / 20120418 ( (2012-04-23 08:53:05 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20120418

[44] Re: Encoding Standard (mostly complete) ( (2012-04-21 03:38:02 +09:00 版)) http://mail.apps.ietf.org/ietf/charsets/msg02054.html

[87] Contributions by Opera (Anne van Kesteren 著, 2012-04-27 13:50:55 +09:00 版) http://lists.w3.org/Archives/Public/public-whatwg-contrib/2012Apr/0008.html

[45] IRC logs: freenode / #whatwg / 20120421 ( (2012-04-28 11:05:01 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20120421

[46] Bug 16773 – Expand the label list ( (2012-05-03 12:13:53 +09:00 版)) https://www.w3.org/Bugs/Public/show_bug.cgi?id=16773

[47] IRC logs: freenode / #whatwg / 20120620 ( (2012-07-04 21:39:52 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20120620#l-445

[48] Encoding Standard ( (2012-09-12 18:58:50 +09:00 版)) http://encoding.spec.whatwg.org/

[49] IRC logs: freenode / #whatwg / 20121010 ( (2012-10-20 11:37:33 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20121010

[50] IRC logs: freenode / #whatwg / 20121013 ( (2012-10-25 00:34:07 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20121013

[51] Single-byte encoding decoders: standard versus browsers ( (2012-11-12 23:21:27 +09:00 版)) http://lists.w3.org/Archives/Public/www-archive/2012Apr/att-0058/spectable.html

[52] IRC logs: freenode / #whatwg / 20121016 ( (2012-11-07 01:14:07 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20121016

[53] Web Applications 1.0 r7647 Embrace the Encodings specification. ( (2013-01-24 10:38:00 +09:00 版)) http://html5.org/tools/web-apps-tracker?from=7646&to=7647

[54] IRC logs: freenode / #whatwg / 20130124 ( (2013-01-25 19:51:13 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20130124#l-765

[55] Web Applications 1.0 r7782 Strip a leading BOM from scripts in workers, if any. Also, use more of the encoding spec. ( (2013-03-30 03:45:00 +09:00 版)) http://html5.org/tools/web-apps-tracker?from=7781&to=7782

[56] IRC logs: freenode / #whatwg / 20130329 ( (2013-04-02 22:21:46 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20130329#l-533

[57] [rust-dev] String encode/decode ( (2013-04-12 05:36:20 +09:00 版)) https://mail.mozilla.org/pipermail/rust-dev/2013-April/003575.html

[58] [whatwg] Requiring the Encoding Standard preferred name is too strict for no good reason ( (2013-07-01 23:18:24 +09:00 版)) http://lists.whatwg.org/pipermail/whatwg-whatwg.org/2013-July/039917.html

[59] Web Applications 1.0 r8081 Closer integration with encoding.spec.whatwg.org ( (2013-07-24 08:16:00 +09:00 版)) http://html5.org/tools/web-apps-tracker?from=8080&to=8081

[60] Web Applications 1.0 r8109 Allow any label for referencing encodings, not just the official name ( (2013-08-01 05:33:00 +09:00 版)) http://html5.org/tools/web-apps-tracker?from=8108&to=8109

[61] [whatwg] Requiring the Encoding Standard preferred name is too strict for no good reason ( (2013-08-01 07:56:15 +09:00 版)) http://lists.whatwg.org/pipermail/whatwg-whatwg.org/2013-July/040313.html

[62] IRC logs: freenode / #whatwg / 20130912 ( (2013-09-15 16:17:53 +09:00 版)) http://krijnhoetmer.nl/irc-logs/whatwg/20130912

[63] Re: Encoding Standard ( (Anne van Kesteren 著, 2013-10-08 22:44:12 +09:00 版)) http://lists.w3.org/Archives/Public/public-i18n-core/2013OctDec/0005.html

[64] 805374 – Remove Character Encoding menu entries that are not in the Encoding Standard ( (2013-11-22 08:51:24 +09:00 版)) https://bugzilla.mozilla.org/show_bug.cgi?id=805374

[65] Web Applications 1.0 r3368 Clarify the encoding aliases mess. ( (2009-07-07 17:26:00 +09:00 版)) http://html5.org/tools/web-apps-tracker?from=3367&to=3368

[66] Encoding ( (2014-01-27 19:44:25 +09:00 版)) http://www.w3.org/TR/2014/WD-encoding-20140128/

[67] Encoding ( (2014-05-30 00:57:18 +09:00 版)) http://www.w3.org/TR/2014/WD-encoding-20140603/

[68] Encoding ( (2014-09-15 19:18:50 +09:00 版)) http://www.w3.org/TR/2014/CR-encoding-20140916/

[69] Encoding specification Disposition of Comments for 2014-06-03 LCWD ( (2014-09-04 13:19:59 +09:00 版)) http://www.w3.org/International/docs/encoding/encoding-doc.html

[70] Issue 412053 - chromium - Align windows-12xx and 874 with the encoding spec - An open-source project to help move the web forward. - Google Project Hosting ( (2014-10-18 03:04:53 +09:00 版)) https://code.google.com/p/chromium/issues/detail?id=412053

[71] Re: Call for Encoding Tests [I18N-ACTION-407] (Anne van Kesteren 著, 2015-02-25 02:56:08 +09:00 版) https://lists.w3.org/Archives/Public/www-international/2015JanMar/0078.html

[72] Encoding ( (2015-10-16 21:20:29 +09:00 版)) http://www.w3.org/TR/2015/CR-encoding-20151020/

[73] Fix #13: rename streaming flag to do not flush flag · whatwg/encoding@6de9a24 (2015-11-08 16:29:55 +09:00 版) https://github.com/whatwg/encoding/commit/6de9a2449937736d0e7f544791bb6c657fc3b47c

[74] Fix #12: clarify how decode() handles end-of-stream · whatwg/encoding@45431e6 (2015-11-08 16:33:26 +09:00 版) https://github.com/whatwg/encoding/commit/45431e6ce485ad50bc489b6e4cf46903398aff2a

[75] web-platform-tests/encoding at master · w3c/web-platform-tests ( (2016-05-27 10:21:55 +09:00)) https://github.com/w3c/web-platform-tests/tree/master/encoding

[76] utf8.js/tests at master · mathiasbynens/utf8.js ( (2016-05-27 10:22:40 +09:00)) https://github.com/mathiasbynens/utf8.js/tree/master/tests

[77] Search · user:mathiasbynens encoding standard ( (2016-05-27 10:23:11 +09:00)) https://github.com/search?q=user%3Amathiasbynens+encoding+standard

[78] hsivonen/encoding_rs: An experimental Gecko-oriented implementation of the Encoding Standard in Rust (2016-07-15 09:46:44 +09:00) https://github.com/hsivonen/encoding_rs

[80] Encoding (2016-11-10 02:35:33 +09:00) https://www.w3.org/TR/2016/CR-encoding-20161110/

[81] Editorial: convert to Bikeshed (annevk著, 2016-11-10 23:16:34 +09:00) https://github.com/whatwg/encoding/commit/bcc0f278c08856f67bdf28b6b82f5d3c482d5cb3

[82] Add visualizations for the indexes (hsivonen著, 2017-01-20 19:45:44 +09:00) https://github.com/whatwg/encoding/commit/7696b7abf42ac13ccb59f183ee4e9e836ade13c2

[83] Meta: enable PR preview, add editor config, and link web-platform-tests (annevk著, 2017-02-22 22:34:30 +09:00) https://github.com/whatwg/encoding/commit/24eb4377bd6d448e71d0f666b550fe9984bc9d05

[84] Meta: fix typo in test URL made in previous commit (annevk著, 2017-02-22 22:50:37 +09:00) https://github.com/whatwg/encoding/commit/f2c66828cebdf1fd79b1735e76ee984b796ba8b5

[85] Encoding (2017-04-11 20:32:31 +09:00) https://www.w3.org/TR/2017/CR-encoding-20170413/

[86] web-platform-tests/encoding at master · w3c/web-platform-tests (2017-04-29 13:53:58 +09:00) https://github.com/w3c/web-platform-tests/tree/master/encoding

[88] Meta: HTML check only if needed, suppress warnings (sideshowbarker著, 2017-05-07 11:12:05 +09:00) https://github.com/whatwg/encoding/commit/8785c3ffe476c1413bf71c1b16f4eecc916e0bc7

[89] Require utf-8 when specifying character encoding by sideshowbarker · Pull Request #3091 · whatwg/html (2017-11-03 20:16:32 +09:00) https://github.com/whatwg/html/pull/3091

[90] Host encoding.spec.whatwg.org (foolip著, 2017-11-02 22:01:06 +09:00) https://github.com/whatwg/misc-server/commit/6e3ad9718916a6c13089eba7b90c244c2e2b3c8d

[91] Meta: use new WHATWG boilerplate and license (domenic著, 2018-01-09 16:40:29 +09:00) https://github.com/whatwg/encoding/commit/d55cb85655eab662da03e3552275c035f1d91daa

[92] Meta: use new WHATWG boilerplate and license by domenic · Pull Request #132 · whatwg/encoding (2018-01-10 22:57:22 +09:00) https://github.com/whatwg/encoding/pull/132

[93] Be clearer on which user agents the API applies to (annevk著, 2018-04-25 21:05:37 +09:00) https://github.com/whatwg/encoding/commit/e72995345427463fb81ec5811a4404d591b49296

[94] Non-browser versus JavaScript · Issue #87 · whatwg/encoding (2018-05-16 14:14:14 +09:00) https://github.com/whatwg/encoding/issues/87

[95] Be clearer on which user agents the API applies to by annevk · Pull Request #136 · whatwg/encoding (2018-05-16 14:15:51 +09:00) https://github.com/whatwg/encoding/pull/136

[96] Review Draft Publication: June 2018 (annevk著, 2018-06-21 22:41:06 +09:00) https://github.com/whatwg/encoding/commit/19af047b7d3c669843f97ae18496951ebd3b5bc4

[97] Review Draft Publication: June 2018 by annevk · Pull Request #147 · whatwg/encoding (2018-06-22 14:55:26 +09:00) https://github.com/whatwg/encoding/pull/147

[98] Encoding Standard Review Draft June 2018 (2018-06-22 01:14:00 +09:00) https://encoding.spec.whatwg.org/review-drafts/2018-06/

[100] Give clearer advice on hooks for standards (annevk著, 2018-04-25 21:22:45 +09:00) https://github.com/whatwg/encoding/commit/b579018b406d7752f8b7a3aa9c2bc800519c6f1a

[101] Give advice around specification hooks · Issue #125 · whatwg/encoding (2018-09-26 18:49:36 +09:00) https://github.com/whatwg/encoding/issues/125

[102] Give clearer advice on hooks for standards by annevk · Pull Request #137 · whatwg/encoding (2018-09-26 18:49:54 +09:00) https://github.com/whatwg/encoding/pull/137

[103] Be clearer on which user agents the API applies to (annevk著, 2018-04-25 21:05:37 +09:00) https://github.com/whatwg/encoding/commit/e72995345427463fb81ec5811a4404d591b49296

[104] Non-browser versus JavaScript · Issue #87 · whatwg/encoding (2019-02-18 12:04:28 +09:00) https://github.com/whatwg/encoding/issues/87

[105] Be clearer on which user agents the API applies to by annevk · Pull Request #136 · whatwg/encoding (2019-02-18 12:06:29 +09:00) https://github.com/whatwg/encoding/pull/136

[106] Memorandum of Understanding Between W3C and WHATWG (2019-05-28 17:23:37 +09:00) https://www.w3.org/2019/04/WHATWG-W3C-MOU.html

[107] Review Draft Publication: December 2018 (annevk著, 2018-12-11 20:52:19 +09:00) https://github.com/whatwg/encoding/commit/c2879dd1673704c51aac86fd4279598324ca792c

[108] Review Draft Publication: December 2018 by annevk · Pull Request #165 · whatwg/encoding (2019-05-31 14:42:59 +09:00) https://github.com/whatwg/encoding/pull/165

[109] Encoding Standard Review Draft December 2018 (2018-12-12 10:02:33 +09:00) https://encoding.spec.whatwg.org/review-drafts/2018-12/

[110] Review Draft Publication: June 2019 (annevk著, 2019-06-17 16:45:08 +09:00) https://github.com/whatwg/encoding/commit/b4ff31c7c423acbe10052b63cbc5f433ae4cecb1

[111] Review Draft Publication: June 2019 by annevk · Pull Request #177 · whatwg/encoding (2020-01-12 14:49:07 +09:00) https://github.com/whatwg/encoding/pull/177

[112] Encoding Standard Review Draft June 2019 (2019-06-20 19:29:18 +09:00) https://encoding.spec.whatwg.org/review-drafts/2019-06/