Difference between revisions of "Char Complexity"

m
Line 1: Line 1:
 
'''1. Problem and history'''
 
'''1. Problem and history'''
  
The complexity of Chinese characters can be measured in terms of the number of strokes. The stroke is a segment written with one uninterrupted movement. The question arises whether complexity follows a regular distribution. Evidently, this is a special case of (→) length distributions. The pertinent statements can be qualified as laws only if they hold for any types of ideograms but up to now no other writing systems have been examined.  
+
The complexity of Chinese characters can be measured in terms of the number of strokes. The stroke is a segment written with one uninterrupted movement. The question arises whether complexity follows a regular distribution. Evidently, this is a special case of (→) length distributions. The pertinent statements can be qualified as laws only if they hold for any types of ideograms but up to now no other writing systems have been examined.
Sanada (1999) shows empirical data on the distribution of strokes in Japanese but does not present a model. Proceeding rather inductively Yu (2001) found that the distribution of character lengths in texts follows the 1-displaced binomial distribution. Previous studies (Herdan 1966, Bohn 1998) did not achieve this result.  
+
 
The distribution in texts and in the dictionary may be quite different because in texts repetition is taken into account. The measurement in terms of the number of strokes is –as a matter of fact – the measurement of length, not that of complexity.
+
Sanada (1999) shows empirical data on the distribution of strokes in Japanese but does not present a model. Proceeding rather inductively, Yu (2001) found that the distribution of character lengths in texts follows the 1-displaced binomial distribution. Previous studies (Herdan 1966, Bohn 1998) did not achieve this result.  
Another kind of complexity of script, in which not only the number of the composing entities but also the kind of their joining is relevant, can be measured according to Altmann (2004) but until now no testing has been performed.
+
 
 +
The distribution in texts and in the dictionary may be quite different because in texts repetition is taken into account. The measurement in terms of the number of strokes is – as a matter of fact – the measurement of length, not that of complexity.
 +
 
 +
Another kind of complexity of script, in which not only the number of the composing entities is relevant, but also the way they ared joined together, can be measured according to Altmann (2004) but until now no testing has been performed.
  
 
'''2. Hypothesis'''
 
'''2. Hypothesis'''
Line 16: Line 19:
 
Solving a (reparametrized) recurrence relation which is a special case of length distributions, namely
 
Solving a (reparametrized) recurrence relation which is a special case of length distributions, namely
  
(1)<math>P_{x+1} = \frac{n-x+1}{x}\frac{p}{q}, \quad x = 1, 2, ..., n+1</math>
+
(1) <math>P_{x+1} = \frac{n-x+1}{x}\frac{p}{q}, \quad x = 1, 2, ..., n+1</math>
 
 
 
 
 
one obtains
 
one obtains
  
(2)<math>P_x = {n \choose x-1}p^{x-1}q^{n-x+1}, \quad x= 1,2,...,n+1, \quad 0<p<1, n\epsilon N</math>
+
(2) <math>P_x = {n \choose x-1}p^{x-1}q^{n-x+1}, \quad x= 1,2,...,n+1, \quad 0<p<1, n\epsilon N</math>
  
 
'''Example''': Chinese characters in texts  
 
'''Example''': Chinese characters in texts  

Revision as of 12:06, 16 June 2009

1. Problem and history

The complexity of Chinese characters can be measured in terms of the number of strokes. The stroke is a segment written with one uninterrupted movement. The question arises whether complexity follows a regular distribution. Evidently, this is a special case of (→) length distributions. The pertinent statements can be qualified as laws only if they hold for any types of ideograms but up to now no other writing systems have been examined.

Sanada (1999) shows empirical data on the distribution of strokes in Japanese but does not present a model. Proceeding rather inductively, Yu (2001) found that the distribution of character lengths in texts follows the 1-displaced binomial distribution. Previous studies (Herdan 1966, Bohn 1998) did not achieve this result.

The distribution in texts and in the dictionary may be quite different because in texts repetition is taken into account. The measurement in terms of the number of strokes is – as a matter of fact – the measurement of length, not that of complexity.

Another kind of complexity of script, in which not only the number of the composing entities is relevant, but also the way they ared joined together, can be measured according to Altmann (2004) but until now no testing has been performed.

2. Hypothesis

The distribution of the complexity of Chinese characters follows a usual length distribution.

Complexity = here the number of strokes in a Chinese sign.

3. Derivation

Solving a (reparametrized) recurrence relation which is a special case of length distributions, namely

(1) P_{x+1} = \frac{n-x+1}{x}\frac{p}{q}, \quad x = 1, 2, ..., n+1

one obtains

(2) P_x = {n \choose x-1}p^{x-1}q^{n-x+1}, \quad x= 1,2,...,n+1, \quad 0<p<1, n\epsilon N

Example: Chinese characters in texts

Yu (2001) tested the above hypothesis on 20 Chinese texts, one of which can be found in Table 1 and Fig. 1.

Figur11 CC.jpg
Figur2 CC.jpg
Fig. 1. The distribution of character complexity in a Chinese text


The result corroborates the hypothesis.


4. Authors: U. Strauss, G. Altmann


5. References

Altmann, G. (2004). Script complexity. Glottometrics 8, 68-74.

Bohn, H. (1998). Quantitative Untersuchungen der modernen chinesischen Sprache und Schrift. Hamburg: Kováč.

Bohn, H.(2002). Untersuchungen zur chinesischen Sprache und Schrift. In: Köhler, R. (ed.), Korpuslinguistische Untersuchungen in die quantitative und systemtheoretische Linguistik: 127-177. http://ubt.opus.hbz-nrw.de/volltexte/2004/279/

Herdan, G. (1966). The advanced theory of language as choice and chance. Berlin: Springer.

Menzel, C. (2002). Das synergetische Basismodell der Lexik und die chinesische Schrift. In: Köhler, R. (ed.), Korpuslinguistische Untersuchungen in die quantitative und systemtheoretische Linguistik: 179-207. http://ubt.opus.hbz-nrw.de/volltexte/2004/279/

Sanada, H. (1999). Analysis of Japanese vocabulary by the theory of synergetic linguistics. J. of Quantitative Linguistics 6, 239-251.

Yu, X. (2001). Zur Komplexität chinesischer Schriftzeichen. Göttinger Beiträge zur Sprachwissenschaft.5, 121-129.