
From jbothun@concentricsky.com  Wed Aug  3 10:37:06 2011
Return-Path: <jbothun@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id C33A221F8ACE for <xml2rfc-dev@ietfa.amsl.com>; Wed,  3 Aug 2011 10:37:06 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8pAxrFepM18D for <xml2rfc-dev@ietfa.amsl.com>; Wed,  3 Aug 2011 10:37:06 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id 4A58121F8AC9 for <xml2rfc-dev@ietf.org>; Wed,  3 Aug 2011 10:37:06 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 452409E8169; Wed,  3 Aug 2011 10:37:08 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id clHmwjSUG039; Wed,  3 Aug 2011 10:37:03 -0700 (PDT)
Received: from [192.168.6.73] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 53A2A9E80A4; Wed,  3 Aug 2011 10:37:03 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Josh Bothun <jbothun@concentricsky.com>
In-Reply-To: <4E34093A.5080402@att.com>
Date: Wed, 3 Aug 2011 10:37:02 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com>
References: <277044E0-588F-4A87-B773-20CAF5CADFC2@concentricsky.com> <62F897A0-3990-47BF-B597-B1729EA82D80@concentricsky.com> <4E34093A.5080402@att.com>
To: Tony Hansen <tony@att.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc Input Document Issues
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 03 Aug 2011 17:37:06 -0000

On Jul 30, 2011, at 6:38 AM, Tony Hansen wrote:

> ...
>=20
> On 7/30/2011 2:13 AM, Mike Biglan wrote:
>> Hi Henrik and Tony,
>>=20
>> Here is a little more detail on what we worked on this past week in =
response to the input documents. We went ahead and tested a set of 450 =
documents in an attempt to categorize the errors, then fix any that =
needed fixing. Below are the categories that had errors and the counts =
in parentheses; this includes issues we have fixed, errors in the =
document or outside our codebase, and open questions.
>>=20
>> FIXED
>>=20
>> 1) Include instructions are being handled properly now.
>>=20
>> 2) No DTD file was declared in the document (12)
>> We had already planned to handle this but it wasn't possible until a =
recent change.  I will implement a function in the application to =
default to rfc2629.dtd if no dtd is declared.
>=20
> I'll note also that the --dtd parameter didn't seem to work either.

This has been fixed in the latest version (2.0.2).

>=20
>> 9) Incorrect DTD filename given (2)
>> Could be a typo or intended to complete later, some files used =
'rfcXXXX.dtd' for the DTD.  If we need to, we can treat this in the same =
way as if no DTD were given, but it might be more appropriate to display =
an error.
>=20
> Can you be more specific about which documents displayed the above =
errors so we can see exactly what you're referring to?

Sure -- the following documents have a DOCTYPE referencing =
"rfcXXXX.dtd":
   draft-dnoveck-nfsv4-storage-control-01.xml
   draft-dnoveck-storage-control-01.xml
   draft-jdfalk-maawg-cfblbcp-01.xml
   draft-kanno-secsh-camellia-02.xml
   draft-kanno-tls-camellia-03.xml
   draft-worley-service-example-07.xml

>=20
> ERROR: Unable to parse the XML document: =
draft-livingood-woundy-p4p-experiences-10.xml
> internal error, line 6, column 70
>=20
>=20
> I hadn't spotted these before. "Internal error" is just as bad as a =
exceptions.

I'm currently looking into these to see how we can better express the =
errors.  It looks like the pattern from documents that throw this is =
that they have syntax errors in the DOCTYPE declaration.

>=20
> Tons of errors like
>=20
> ERROR: Unable to validate the XML document: =
draft-maino-lisp-sec-00.xml
> Line 407: IDREF attribute target references an unknown ID "RFC5226"
>=20
>=20
> that need to be understood.
>=20
>   Tony

This large class of errors you are getting seems to be an issue with the =
citation loading -- I would be curious if you ran the latest HEAD again =
with some of my new changes if the problem still exists.

I am able to replicate the error by invalidating my XML_LIBRARY path, or =
by removing the citation document entirely, however the script will also =
then print a warning saying that the include could not be resolved.  =
I've made it warning level instead of error level because it doesn't =
actually halt the parser, since processing instructions are not limited =
by the DTD, however it may be more appropriate for this to be an error.
	=09
If the error is still coming up, I believe that means the citation =
document was not found in $XML_LIBRARY OR in the same directory as the =
input XML file.  Running the script with --verbose may help because it =
prints the path to the reference its trying to load.

-josh

From tony@att.com  Thu Aug  4 11:18:29 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E8E3821F88B7 for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:18:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.098
X-Spam-Level: 
X-Spam-Status: No, score=-106.098 tagged_above=-999 required=5 tests=[AWL=0.501, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ms03fu2xnrPE for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:18:29 -0700 (PDT)
Received: from mail120.messagelabs.com (mail120.messagelabs.com [216.82.250.83]) by ietfa.amsl.com (Postfix) with ESMTP id 3769121F88DC for <xml2rfc-dev@ietf.org>; Thu,  4 Aug 2011 11:18:29 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-12.tower-120.messagelabs.com!1312481922!31255543!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 9642 invoked from network); 4 Aug 2011 18:18:43 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-12.tower-120.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 4 Aug 2011 18:18:43 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74IJ7ih024524 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:19:08 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74IJ1Pj024398 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:19:01 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IIZqc014826 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:18:35 -0400
Received: from mailgw1.maillennium.att.com (mailgw1.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IISBS014622 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:18:29 -0400
Received: from [135.70.173.193] (vpn-135-70-173-193.vpn.mwst.att.com[135.70.173.193]) by maillennium.att.com (mailgw1) with ESMTP id <20110804181826gw100e4l1ee> (Authid: tony); Thu, 4 Aug 2011 18:18:27 +0000
X-Originating-IP: [135.70.173.193]
Message-ID: <4E3AE26F.20007@att.com>
Date: Thu, 04 Aug 2011 14:18:23 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <277044E0-588F-4A87-B773-20CAF5CADFC2@concentricsky.com> <62F897A0-3990-47BF-B597-B1729EA82D80@concentricsky.com> <4E34093A.5080402@att.com> <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com>
In-Reply-To: <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc Input Document Issues
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Aug 2011 18:18:30 -0000

I'm trying to do an install with the latest version and I get the error 
message

     error: can't combine user with prefix/exec_prefix/home or 
install_(plat)base

I've been installing it using

     python setup.py install --home ~

Please advise.

     Tony

On 8/3/2011 1:37 PM, Josh Bothun wrote:
> On Jul 30, 2011, at 6:38 AM, Tony Hansen wrote:
>
>> ...
>>
>> On 7/30/2011 2:13 AM, Mike Biglan wrote:
>>> Hi Henrik and Tony,
>>>
>>> Here is a little more detail on what we worked on this past week in response to the input documents. We went ahead and tested a set of 450 documents in an attempt to categorize the errors, then fix any that needed fixing. Below are the categories that had errors and the counts in parentheses; this includes issues we have fixed, errors in the document or outside our codebase, and open questions.
>>>
>>> FIXED
>>>
>>> 1) Include instructions are being handled properly now.
>>>
>>> 2) No DTD file was declared in the document (12)
>>> We had already planned to handle this but it wasn't possible until a recent change.  I will implement a function in the application to default to rfc2629.dtd if no dtd is declared.
>> I'll note also that the --dtd parameter didn't seem to work either.
> This has been fixed in the latest version (2.0.2).
>
>>> 9) Incorrect DTD filename given (2)
>>> Could be a typo or intended to complete later, some files used 'rfcXXXX.dtd' for the DTD.  If we need to, we can treat this in the same way as if no DTD were given, but it might be more appropriate to display an error.
>> Can you be more specific about which documents displayed the above errors so we can see exactly what you're referring to?
> Sure -- the following documents have a DOCTYPE referencing "rfcXXXX.dtd":
>     draft-dnoveck-nfsv4-storage-control-01.xml
>     draft-dnoveck-storage-control-01.xml
>     draft-jdfalk-maawg-cfblbcp-01.xml
>     draft-kanno-secsh-camellia-02.xml
>     draft-kanno-tls-camellia-03.xml
>     draft-worley-service-example-07.xml
>
>> ERROR: Unable to parse the XML document: draft-livingood-woundy-p4p-experiences-10.xml
>> internal error, line 6, column 70
>>
>>
>> I hadn't spotted these before. "Internal error" is just as bad as a exceptions.
> I'm currently looking into these to see how we can better express the errors.  It looks like the pattern from documents that throw this is that they have syntax errors in the DOCTYPE declaration.
>
>> Tons of errors like
>>
>> ERROR: Unable to validate the XML document: draft-maino-lisp-sec-00.xml
>> Line 407: IDREF attribute target references an unknown ID "RFC5226"
>>
>>
>> that need to be understood.
>>
>>    Tony
> This large class of errors you are getting seems to be an issue with the citation loading -- I would be curious if you ran the latest HEAD again with some of my new changes if the problem still exists.
>
> I am able to replicate the error by invalidating my XML_LIBRARY path, or by removing the citation document entirely, however the script will also then print a warning saying that the include could not be resolved.  I've made it warning level instead of error level because it doesn't actually halt the parser, since processing instructions are not limited by the DTD, however it may be more appropriate for this to be an error.
> 		
> If the error is still coming up, I believe that means the citation document was not found in $XML_LIBRARY OR in the same directory as the input XML file.  Running the script with --verbose may help because it prints the path to the reference its trying to load.
>
> -josh

From tony@att.com  Thu Aug  4 11:20:59 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 93DF521F88DD for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:20:59 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.115
X-Spam-Level: 
X-Spam-Status: No, score=-106.115 tagged_above=-999 required=5 tests=[AWL=0.484, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id M-3yAlLre58Z for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:20:59 -0700 (PDT)
Received: from mail119.messagelabs.com (mail119.messagelabs.com [216.82.241.195]) by ietfa.amsl.com (Postfix) with ESMTP id B53A721F88D9 for <xml2rfc-dev@ietf.org>; Thu,  4 Aug 2011 11:20:58 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-4.tower-119.messagelabs.com!1312482072!32458532!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 3254 invoked from network); 4 Aug 2011 18:21:12 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-4.tower-119.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 4 Aug 2011 18:21:12 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74ILZwf027577 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:21:35 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74ILWU0027557 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:21:32 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IL6W5020581 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:21:06 -0400
Received: from dns.maillennium.att.com (dns.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IL2rF020535 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:21:02 -0400
Received: from [135.70.173.193] (vpn-135-70-173-193.vpn.mwst.att.com[135.70.173.193]) by maillennium.att.com (mailgw1) with ESMTP id <20110804182102gw100e4l1fe> (Authid: tony); Thu, 4 Aug 2011 18:21:02 +0000
X-Originating-IP: [135.70.173.193]
Message-ID: <4E3AE30B.5000508@att.com>
Date: Thu, 04 Aug 2011 14:20:59 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <277044E0-588F-4A87-B773-20CAF5CADFC2@concentricsky.com> <62F897A0-3990-47BF-B597-B1729EA82D80@concentricsky.com> <4E34093A.5080402@att.com> <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com> <4E3AE26F.20007@att.com>
In-Reply-To: <4E3AE26F.20007@att.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc Input Document Issues
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Aug 2011 18:20:59 -0000

PS. If I leave off --home ~, it installs into ~/.local.

     Tony

On 8/4/2011 2:18 PM, Tony Hansen wrote:
> I'm trying to do an install with the latest version and I get the 
> error message
>
>     error: can't combine user with prefix/exec_prefix/home or 
> install_(plat)base
>
> I've been installing it using
>
>     python setup.py install --home ~
>
> Please advise.
>
>     Tony
>
> On 8/3/2011 1:37 PM, Josh Bothun wrote:
>> On Jul 30, 2011, at 6:38 AM, Tony Hansen wrote:
>>
>>> ...
>>>
>>> On 7/30/2011 2:13 AM, Mike Biglan wrote:
>>>> Hi Henrik and Tony,
>>>>
>>>> Here is a little more detail on what we worked on this past week in 
>>>> response to the input documents. We went ahead and tested a set of 
>>>> 450 documents in an attempt to categorize the errors, then fix any 
>>>> that needed fixing. Below are the categories that had errors and 
>>>> the counts in parentheses; this includes issues we have fixed, 
>>>> errors in the document or outside our codebase, and open questions.
>>>>
>>>> FIXED
>>>>
>>>> 1) Include instructions are being handled properly now.
>>>>
>>>> 2) No DTD file was declared in the document (12)
>>>> We had already planned to handle this but it wasn't possible until 
>>>> a recent change.  I will implement a function in the application to 
>>>> default to rfc2629.dtd if no dtd is declared.
>>> I'll note also that the --dtd parameter didn't seem to work either.
>> This has been fixed in the latest version (2.0.2).
>>
>>>> 9) Incorrect DTD filename given (2)
>>>> Could be a typo or intended to complete later, some files used 
>>>> 'rfcXXXX.dtd' for the DTD.  If we need to, we can treat this in the 
>>>> same way as if no DTD were given, but it might be more appropriate 
>>>> to display an error.
>>> Can you be more specific about which documents displayed the above 
>>> errors so we can see exactly what you're referring to?
>> Sure -- the following documents have a DOCTYPE referencing 
>> "rfcXXXX.dtd":
>>     draft-dnoveck-nfsv4-storage-control-01.xml
>>     draft-dnoveck-storage-control-01.xml
>>     draft-jdfalk-maawg-cfblbcp-01.xml
>>     draft-kanno-secsh-camellia-02.xml
>>     draft-kanno-tls-camellia-03.xml
>>     draft-worley-service-example-07.xml
>>
>>> ERROR: Unable to parse the XML document: 
>>> draft-livingood-woundy-p4p-experiences-10.xml
>>> internal error, line 6, column 70
>>>
>>>
>>> I hadn't spotted these before. "Internal error" is just as bad as a 
>>> exceptions.
>> I'm currently looking into these to see how we can better express the 
>> errors.  It looks like the pattern from documents that throw this is 
>> that they have syntax errors in the DOCTYPE declaration.
>>
>>> Tons of errors like
>>>
>>> ERROR: Unable to validate the XML document: draft-maino-lisp-sec-00.xml
>>> Line 407: IDREF attribute target references an unknown ID "RFC5226"
>>>
>>>
>>> that need to be understood.
>>>
>>>    Tony
>> This large class of errors you are getting seems to be an issue with 
>> the citation loading -- I would be curious if you ran the latest HEAD 
>> again with some of my new changes if the problem still exists.
>>
>> I am able to replicate the error by invalidating my XML_LIBRARY path, 
>> or by removing the citation document entirely, however the script 
>> will also then print a warning saying that the include could not be 
>> resolved.  I've made it warning level instead of error level because 
>> it doesn't actually halt the parser, since processing instructions 
>> are not limited by the DTD, however it may be more appropriate for 
>> this to be an error.
>>
>> If the error is still coming up, I believe that means the citation 
>> document was not found in $XML_LIBRARY OR in the same directory as 
>> the input XML file.  Running the script with --verbose may help 
>> because it prints the path to the reference its trying to load.
>>
>> -josh
> _______________________________________________
> xml2rfc-dev mailing list
> xml2rfc-dev@ietf.org
> https://www.ietf.org/mailman/listinfo/xml2rfc-dev

From tony@att.com  Thu Aug  4 11:34:46 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9B75811E808C for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:34:46 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.13
X-Spam-Level: 
X-Spam-Status: No, score=-106.13 tagged_above=-999 required=5 tests=[AWL=0.469, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hlK+q4bN87XI for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 11:34:45 -0700 (PDT)
Received: from mail120.messagelabs.com (mail120.messagelabs.com [216.82.250.83]) by ietfa.amsl.com (Postfix) with ESMTP id B6C7B11E8077 for <xml2rfc-dev@ietf.org>; Thu,  4 Aug 2011 11:34:45 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-2.tower-120.messagelabs.com!1312482898!31252540!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 24445 invoked from network); 4 Aug 2011 18:35:00 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-2.tower-120.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 4 Aug 2011 18:35:00 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74IZIlM016583 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:35:24 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p74IYuTT015873 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:34:57 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IYUV0016243 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:34:30 -0400
Received: from mailgw1.maillennium.att.com (mailgw1.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p74IYQVx016099 for <xml2rfc-dev@ietf.org>; Thu, 4 Aug 2011 14:34:26 -0400
Received: from [135.70.173.193] (vpn-135-70-173-193.vpn.mwst.att.com[135.70.173.193]) by maillennium.att.com (mailgw1) with ESMTP id <20110804183425gw100e4l1je> (Authid: tony); Thu, 4 Aug 2011 18:34:26 +0000
X-Originating-IP: [135.70.173.193]
Message-ID: <4E3AE62F.5020206@att.com>
Date: Thu, 04 Aug 2011 14:34:23 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <277044E0-588F-4A87-B773-20CAF5CADFC2@concentricsky.com> <62F897A0-3990-47BF-B597-B1729EA82D80@concentricsky.com> <4E34093A.5080402@att.com> <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com>
In-Reply-To: <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc Input Document Issues
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Aug 2011 18:34:46 -0000

On 8/3/2011 1:37 PM, Josh Bothun wrote:
> This large class of errors you are getting seems to be an issue with the citation loading -- I would be curious if you ran the latest HEAD again with some of my new changes if the problem still exists.
>
> I am able to replicate the error by invalidating my XML_LIBRARY path, or by removing the citation document entirely, however the script will also then print a warning saying that the include could not be resolved.  I've made it warning level instead of error level because it doesn't actually halt the parser, since processing instructions are not limited by the DTD, however it may be more appropriate for this to be an error.
> 		
> If the error is still coming up, I believe that means the citation document was not found in $XML_LIBRARY OR in the same directory as the input XML file.  Running the script with --verbose may help because it prints the path to the reference its trying to load.

How is the $XML_LIBRARY path used? What should it point to? (What is 
expected to be found where it points?) How do what's found in the ENTITY 
references relate?

     Tony



From jbothun@concentricsky.com  Thu Aug  4 13:23:05 2011
Return-Path: <jbothun@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F08F15E8001 for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 13:23:05 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.264
X-Spam-Level: 
X-Spam-Status: No, score=-2.264 tagged_above=-999 required=5 tests=[AWL=-0.000, BAYES_00=-2.599, HTML_MESSAGE=0.001, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jemaiujUtDMF for <xml2rfc-dev@ietfa.amsl.com>; Thu,  4 Aug 2011 13:23:05 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id C789221F89BE for <xml2rfc-dev@ietf.org>; Thu,  4 Aug 2011 13:23:03 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id E4A879E8113; Thu,  4 Aug 2011 13:23:09 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Q-n+GWf8pIHl; Thu,  4 Aug 2011 13:23:05 -0700 (PDT)
Received: from [192.168.6.73] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 674F79E80DA; Thu,  4 Aug 2011 13:23:05 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-1--825266257
From: Josh Bothun <jbothun@concentricsky.com>
In-Reply-To: <4E3AE62F.5020206@att.com>
Date: Thu, 4 Aug 2011 13:23:02 -0700
Message-Id: <C1B782CB-1A7A-404D-8E27-F892505CF4A2@concentricsky.com>
References: <277044E0-588F-4A87-B773-20CAF5CADFC2@concentricsky.com> <62F897A0-3990-47BF-B597-B1729EA82D80@concentricsky.com> <4E34093A.5080402@att.com> <6EC89A4F-1471-4E9F-80AA-5DA1D6115C27@concentricsky.com> <4E3AE62F.5020206@att.com>
To: Tony Hansen <tony@att.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc Input Document Issues
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Aug 2011 20:23:06 -0000

--Apple-Mail-1--825266257
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii


On Aug 4, 2011, at 11:34 AM, Tony Hansen wrote:

> On 8/3/2011 1:37 PM, Josh Bothun wrote:
>> This large class of errors you are getting seems to be an issue with =
the citation loading -- I would be curious if you ran the latest HEAD =
again with some of my new changes if the problem still exists.
>>=20
>> I am able to replicate the error by invalidating my XML_LIBRARY path, =
or by removing the citation document entirely, however the script will =
also then print a warning saying that the include could not be resolved. =
 I've made it warning level instead of error level because it doesn't =
actually halt the parser, since processing instructions are not limited =
by the DTD, however it may be more appropriate for this to be an error.
>> 	=09
>> If the error is still coming up, I believe that means the citation =
document was not found in $XML_LIBRARY OR in the same directory as the =
input XML file.  Running the script with --verbose may help because it =
prints the path to the reference its trying to load.
>=20
> How is the $XML_LIBRARY path used? What should it point to? (What is =
expected to be found where it points?) How do what's found in the ENTITY =
references relate?
>=20
>    Tony
>=20
>=20

Following the documentation of the old tool here: =
http://xml.resource.org/authoring/README.html#include.file.facility, an =
<?rfc include> instruction that contains a filename (not a full URL) =
will first look for the filename in $XML_LIBRARY, if it is set, and then =
look in the same directory as the input file.

Likewise, an ENTITY reference that only contains a filename instead of a =
full URL follows the same behavior -- first trying $XML_LIBRARY, then =
the directory of the input file.

-josh=

--Apple-Mail-1--825266257
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=us-ascii

<html><head></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space; =
"><br><div><div>On Aug 4, 2011, at 11:34 AM, Tony Hansen wrote:</div><br =
class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><div>On =
8/3/2011 1:37 PM, Josh Bothun wrote:<br><blockquote type=3D"cite">This =
large class of errors you are getting seems to be an issue with the =
citation loading -- I would be curious if you ran the latest HEAD again =
with some of my new changes if the problem still =
exists.<br></blockquote><blockquote =
type=3D"cite"><br></blockquote><blockquote type=3D"cite">I am able to =
replicate the error by invalidating my XML_LIBRARY path, or by removing =
the citation document entirely, however the script will also then print =
a warning saying that the include could not be resolved. &nbsp;I've made =
it warning level instead of error level because it doesn't actually halt =
the parser, since processing instructions are not limited by the DTD, =
however it may be more appropriate for this to be an =
error.<br></blockquote><blockquote type=3D"cite"><span =
class=3D"Apple-tab-span" style=3D"white-space:pre">	</span><span =
class=3D"Apple-tab-span" style=3D"white-space:pre">	=
</span><br></blockquote><blockquote type=3D"cite">If the error is still =
coming up, I believe that means the citation document was not found in =
$XML_LIBRARY OR in the same directory as the input XML file. =
&nbsp;Running the script with --verbose may help because it prints the =
path to the reference its trying to load.<br></blockquote><br>How is the =
$XML_LIBRARY path used? What should it point to? (What is expected to be =
found where it points?) How do what's found in the ENTITY references =
relate?<br><br> =
&nbsp;&nbsp;&nbsp;Tony<br><br><br></div></blockquote></div><br><div>Follow=
ing the documentation of the old tool here:&nbsp;<a =
href=3D"http://xml.resource.org/authoring/README.html#include.file.facilit=
y">http://xml.resource.org/authoring/README.html#include.file.facility</a>=
, an &lt;?rfc include&gt; instruction that contains a filename (not a =
full URL) will first look for the filename in $XML_LIBRARY, if it is =
set, and then look in the same directory as the input =
file.</div><div><br></div><div>Likewise, an ENTITY reference that only =
contains a filename instead of a full URL follows the same behavior -- =
first trying $XML_LIBRARY, then the directory of the input =
file.</div><div><br></div><div>-josh</div></body></html>=

--Apple-Mail-1--825266257--

From henrik@levkowetz.com  Mon Aug 15 04:18:39 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EF70421F8B47 for <xml2rfc-dev@ietfa.amsl.com>; Mon, 15 Aug 2011 04:18:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.6
X-Spam-Level: 
X-Spam-Status: No, score=-102.6 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id D8cgC3r6wowk for <xml2rfc-dev@ietfa.amsl.com>; Mon, 15 Aug 2011 04:18:38 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 3CBD121F86AA for <xml2rfc-dev@ietf.org>; Mon, 15 Aug 2011 04:18:38 -0700 (PDT)
Received: from brunello.autonomica.se ([2a01:3f0:1:0:21e:c2ff:fe13:7e3e]:51676 helo=brunello.netnod.se) by merlot.tools.ietf.org with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1QsvCB-0000p0-MD; Mon, 15 Aug 2011 13:19:06 +0200
Message-ID: <4E4900A6.8070909@levkowetz.com>
Date: Mon, 15 Aug 2011 13:19:02 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <E8E1B3CD-EE8F-4DE1-A7A9-CE1FEC1E69C6@concentricsky.com>
In-Reply-To: <E8E1B3CD-EE8F-4DE1-A7A9-CE1FEC1E69C6@concentricsky.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 2a01:3f0:1:0:21e:c2ff:fe13:7e3e
X-SA-Exim-Rcpt-To: jbothun@concentricsky.com, henrik@zinfandel.tools.ietf.org, mike@concentricsky.com, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: Henrik Levkowetz <henrik@zinfandel.tools.ietf.org>, xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] Testing xml2rfc-gui alpha on linux
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 15 Aug 2011 11:18:39 -0000

Hi Josh,

Thanks for this.  The procedure below brings up the GUI all right, and
lets me try it out.  Comments on that below.

There are however some other things to comment on, also:

On 2011-08-13 02:05 Josh Bothun said:
> Hi Henrik,
> 
> We are currently still in the process of weighing our options and
> testing various methods of distributing debian and rpm packages for
> linux.
> 
> In the meantime, perhaps the best way for you to be able to test the
> GUI alpha on your debian OS would be with the following procedure:
> 
> 1.  Checkout the latest version of the SVN repository -- the following commands are run from the repository root.

Right.  I see you put the command-line stuff under version2/cli/,
excellent.

> 2.  Install the debian package for pyqt4
> 	$ sudo apt-get install python-qt4

No problems, as expected.

> 3.  Install xml2rfc
> 	$ cd cli && python setup.py install

I first ran this as user, which installed both libs and executable
under ~/.local/bin/, which isn't on my path, and was somewhat
unexpected.  I then ran this as root, which installed to the same path.
I then tried to figure out how to do a system install, and tried --prefix,
but that gave an error message:

  "error: can't combine user with with prefix/exec_prefix/home or install_(plat)base"

I think that for the Linux install, we need to revert to what you had
before, with system install as default, user install on demand.  The
current behaviour diverges too much from the conventions and expected
behaviour for python setup.py-based installs.  The installation
instructions should however specify exactly which switch settings are
needed to install locally for a user, and how to make the executable
end up in a place on the user's path.

> 4.  Run the GUI
> 	$ gui/xml2rfc-gui

This comes up fine, however when trying it out, I got an error for one
of my more recent drafts, which made me plug the new xml2rfc into my
draft generation makefile, which does a lot more than just run xml2rfc
-- it sets up everything needed for local processing, including
spellchecking, nits-checking, xmllint-checking and more.

Having the makefile up and running, I found this:

* running xml2rfc (the cli) with --exp produces an expanded XML file
  which lacks the <!DOCTYPE rfc SYSTEM "rfc2629.dtd"> entry which is
  needed for proper processing with xmllint -- this should probably
  be present in the expanded file.  (I fixed this temporarily in my
  copy of writers/expanded_xml.py).

> The gui will then run, invoking the system installed version of
> xml2rfc.  You'll get an import exception if either python-qt4 or
> xml2rfc are not installed.

Works.

> We have tested this process to work on fresh installs of Ubuntu 11
> and Debian 6, both 32-bit and 64-bit, and will continue to do more
> extensive testing on Fedora, openSUSE, and Mint.
> 
> Please let me know if there are any issues here in getting the GUI
> application to run with this method, and have a great weekend!

Only issue with this seems to be the cli install issue mentioned above.
Thanks!  Comments on the GUI in a separate response to your original
email.


Best regards,

	Henrik

From henrik@levkowetz.com  Mon Aug 15 05:38:29 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 351A621F8B6B for <xml2rfc-dev@ietfa.amsl.com>; Mon, 15 Aug 2011 05:38:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.6
X-Spam-Level: 
X-Spam-Status: No, score=-102.6 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WNNsvw6Qo2qM for <xml2rfc-dev@ietfa.amsl.com>; Mon, 15 Aug 2011 05:38:28 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 2AE2C21F8B10 for <xml2rfc-dev@ietf.org>; Mon, 15 Aug 2011 05:38:28 -0700 (PDT)
Received: from brunello.autonomica.se ([2a01:3f0:1:0:21e:c2ff:fe13:7e3e]:51823 helo=brunello.netnod.se) by merlot.tools.ietf.org with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1QswRb-00011N-3q; Mon, 15 Aug 2011 14:39:04 +0200
Message-ID: <4E491366.7060503@levkowetz.com>
Date: Mon, 15 Aug 2011 14:39:02 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11
MIME-Version: 1.0
To: Mike Biglan <mike@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com>
In-Reply-To: <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 2a01:3f0:1:0:21e:c2ff:fe13:7e3e
X-SA-Exim-Rcpt-To: mike@concentricsky.com, jbothun@concentricsky.com, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 15 Aug 2011 12:38:29 -0000

Hi Mike,

On 2011-08-11 01:48 Mike Biglan said:

> 
> USAGE
> 
> Documents are added to the queue by clicking 'Add File(s)' or going
> to File > Add File(s) in the menu. This will populate the list on the
> left.

Having tried this out, I'm not sure that
 - The idea of a list and queue of sources is helpful, as compared with
   handling a single document source at a time
 - The layout of the source and target input elements are logical.  The
   output directory field in particular is situated before the input
   source field, which seems backward to me.

For the first one, one idea might be to look at other GUIs which
does similar processing of source to target files; one group of such
which comes to mind is expanders/viewers of compressed files.  There
is often no document window at all until one has chosen a source file,
and batch/queued processing is a special option if available at all.
Settings are handled by a separate window, rather than as part of
the main window (which currently has the 'Output directory' setting).

My suggestions would be:

  * Get rid of the queue and the queue window, but show the
    path and name of the source file above the tab pane.
  * Get rid of the output directory field in the main window.
  * Have only one way of choosing the source file, i.e., from the
    file menu
  * By default, the output files go in the same directory as the
    source file.  Sending output somewhere else can be handled by
    in the Preferences window.
  * Having one area for conversion settings right below the menu
    is OK, I guess, even if I would rather have had it as option
    menu toggles.
  * One tab pane should be enough, rather than having two as is
    done now, if one of the tabs show the source with errors indicated
    inline.  Then you could 
	1) show the source in the xml tab when a source has been
	   chosen,
	2) show processing progress in the output pane when 'convert'
	   has been pressed
 	3) show output in output tabs (those could be created as
	   output becomes available, rather than always being
	   present, *if that's easy*) when available, or go back
	   to an editable source pane for error fixes.
    If error indication is only available in the output pane,
    then I guess we need to keep the two tab panes.

> To preview any of these documents, double click the name or
> icon of the document and its converted format will be displayed in
> the main view, unless there were any errors in conversion, in which
> case the errors are printed to the text output in the bottom pane,
> and a highlighted line of XML is opened in the main view containing
> the error. For working documents, clicking the other tabs in the main
> view (HTML, Nroff...) will show you the preview for that format.

None of the tabs shows any content when I run the current SVN HEAD
under Debian Linux, using the procedure you sent on the 12th.  The
files in the designated output directory looks fine, on the other
hand.

> Clicking the 'Convert' button on the upper right corner of the screen
> will convert ALL of the documents in the document queue to the
> formats enabled under 'Formats', and output them to the directory
> specified under 'Output directory', using any additional settings
> specified under 'Settings'.
> 
> 
> APPLICATION DETAILS
> 
> Xml2rfc-gui bundles an internal snapshot of xml2rfc along with it;
> this means it does not invoke the *system* installed xml2rfc. The
> xml2rfc-gui package will operate exactly the same regardless of
> whether xml2rfc is installed or the specifics of the version.
> However, since python imports are resolved dynamically, I suppose it
> is technically possible if you were to remove the xml2rfc binaries
> from the xml2rfc-gui package that the xml2rfc import would then
> resolve to the system version, but this would be difficult to do
> without breaking the application and a fairly unusual use-case.

This makes some sense, although it may also surprise some people,
especially on Linux.  I don't think this is enough to change the
approach, though.

> The preferences window (found by going to 'Options' in the menu, then
> 'Preferences') allows you to set the Cache and Citation Library
> directories, along with change various appearance and behavior
> settings of the application.

Right.

> Any GUI elements which are able to invoke the worker thread (document
> queue, convert button) are disabled during processing, to keep the
> application thread-safe. I believe on all operating systems it just
> shows them as grayed-out.> 

Ok.

> CURRENT WORK IN PROGRESS
> 
> - Safely halting execution during batch processing
> - Creating About and Help menu pages
> - Version checking and updating. Let us know if you don't think this
>   is needed.

Version checking will be helpful; having people do the download and
re-install themselves will be acceptable.

> - Generating and displaying a summary report after running a batch
>   conversion, optionally saving to a log file or shown to the user.

See above; if we need a batch option and it shows output in an output
tab, and that output can be copied, I think it's enough.

> - The templates directory is bundled in the same directory as the
>   application.  It may be more appropriate to go in a hidden location,
>   if desired, which can be accomplished in the installer.

Ok.

> We appreciate any feedback you have about the application thus far --
> and talk with you soon,

I hope the feedback above is helpful; I expect other people on the
xml2rfc-dev list will also have feedback.


Best regards,

	Henrik


From mike@concentricsky.com  Tue Aug 16 22:29:23 2011
Return-Path: <mike@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 852EF21F8B20 for <xml2rfc-dev@ietfa.amsl.com>; Tue, 16 Aug 2011 22:29:23 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hLRDBVi1uo60 for <xml2rfc-dev@ietfa.amsl.com>; Tue, 16 Aug 2011 22:29:22 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id AA27E21F8B13 for <xml2rfc-dev@ietf.org>; Tue, 16 Aug 2011 22:29:22 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 916239E805C; Tue, 16 Aug 2011 22:30:05 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xu4H7TqQsyIp; Tue, 16 Aug 2011 22:30:01 -0700 (PDT)
Received: from [192.168.6.157] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id A55829E8026; Tue, 16 Aug 2011 22:30:00 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Mike Biglan <mike@concentricsky.com>
In-Reply-To: <4E491366.7060503@levkowetz.com>
Date: Tue, 16 Aug 2011 22:29:56 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com>
To: Henrik Levkowetz <henrik@levkowetz.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 05:29:23 -0000

Hi Henrik and All,

We've prepared major updates to the GUI application based on your =
suggestions Henrik. All these are committed to SVN. In addition, here =
are the OSX and Windows builds of this version (though not updates on =
the deb packages yet):
  - Mac: http://minornine.com/xml2rfc/xml2rfc-gui-0.6.0-osx.zip
  - Windows: http://minornine.com/xml2rfc/xml2rfc-gui-0.6.0-win32.zip

Specific updates to GUI App:
 =20
  - Batch queue removed
  - Source document is added from File > Open Source
  - Various new options in preferences and menus
  - Stderr/stdout views collapsed into one view
  - Output tabs are created/destroyed as needed
  - Multiple lines will now be highlighted for errors
  - Experimental support for clicking error 'links' in the console to =
jump to an error
  - Some persistence added to application temporary settings
  - Application takes an input file as an argument now
  - Version bumped to 0.6.0


> Having tried this out, I'm not sure that the idea of a list and queue =
of sources is helpful, as compared with handling a single document =
source at a time


Our old code could do the batch processing mode and that is still in the =
SVN history. Perhaps this would be more appropriate as a separate branch =
in the repository. We spent a fair amount of time putting that together =
and found it very helpful in our (batch) testing. If anyone else on this =
list has interest in this, please let us know.


One other note. At this point we opted not to display errors 'inline' =
because that seems to conflict with being able to edit the XML directly =
in the application. Please let us know if you'd like us to change this.

Hope this is helpful -- and appreciate all the feedback,=20

Mike=

From henrik@levkowetz.com  Wed Aug 17 04:03:03 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8C20E21F853E for <xml2rfc-dev@ietfa.amsl.com>; Wed, 17 Aug 2011 04:03:03 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.5
X-Spam-Level: 
X-Spam-Status: No, score=-102.5 tagged_above=-999 required=5 tests=[AWL=0.100,  BAYES_00=-2.599, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Z2ln8hCEAtlw for <xml2rfc-dev@ietfa.amsl.com>; Wed, 17 Aug 2011 04:03:02 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 333A221F86B3 for <xml2rfc-dev@ietf.org>; Wed, 17 Aug 2011 04:02:56 -0700 (PDT)
Received: from brunello.autonomica.se ([2a01:3f0:1:0:21e:c2ff:fe13:7e3e]:60371 helo=brunello.netnod.se) by merlot.tools.ietf.org with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qtdu9-0008NJ-LH; Wed, 17 Aug 2011 13:03:27 +0200
Message-ID: <4E4B9FFC.5060704@levkowetz.com>
Date: Wed, 17 Aug 2011 13:03:24 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11
MIME-Version: 1.0
To: Mike Biglan <mike@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com>
In-Reply-To: <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 2a01:3f0:1:0:21e:c2ff:fe13:7e3e
X-SA-Exim-Rcpt-To: mike@concentricsky.com, jbothun@concentricsky.com, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 11:03:03 -0000

Hi Mike,

On 2011-08-17 07:29 Mike Biglan said:
> Hi Henrik and All,
> 
> We've prepared major updates to the GUI application based on your suggestions Henrik. All these are committed to SVN. In addition, here are the OSX and Windows builds of this version (though not updates on the deb packages yet):
>   - Mac: http://minornine.com/xml2rfc/xml2rfc-gui-0.6.0-osx.zip
>   - Windows: http://minornine.com/xml2rfc/xml2rfc-gui-0.6.0-win32.zip

That's fast turnaround.  Thank you.

> Specific updates to GUI App:
>   
>   - Batch queue removed
>   - Source document is added from File > Open Source
>   - Various new options in preferences and menus
>   - Stderr/stdout views collapsed into one view
>   - Output tabs are created/destroyed as needed
>   - Multiple lines will now be highlighted for errors
>   - Experimental support for clicking error 'links' in the console to jump to an error
>   - Some persistence added to application temporary settings
>   - Application takes an input file as an argument now
>   - Version bumped to 0.6.0

The new version looks good to me so far (some comments below, though).
Nice to see the Mac version, too :-)

Trying this one out, there's one thing I'd like differently, related to
the references library.  I'm used to being able to give a set of paths
for this, which makes it possible for me to have all regular references
in the bibxml*/ directories, while document-specific references are placed
in a local ./references/ directory.  This begs two questions:

Does the GUI version honor any environment variable which could be set
to a list of directories (in addition to the preferences setting)?

Would it be possible to make the preferences setting editable as a
text box (in addition to, or as a complement to the current file find
dialog mechanism) and make it accept a list of places to look for a
reference file, rather than just one?

>> Having tried this out, I'm not sure that the idea of a list and
>> queue of sources is helpful, as compared with handling a single
>> document source at a time
> 
> 
> Our old code could do the batch processing mode and that is still in
> the SVN history. Perhaps this would be more appropriate as a separate
> branch in the repository. We spent a fair amount of time putting that
> together and found it very helpful in our (batch) testing.

Right, that makes sense and was worthwhile.

> If anyone
> else on this list has interest in this, please let us know.

If it's fairly easy to accomplish, maybe you could keep the functionality
even if the visible UI support is different, by permitting the selection
of multiple files in File Open.  You can't see the individual output files
by selecting a specific entry in the queue anymore, but the output window
could still reflect how things have gone.  Up to you, really.

> One other note. At this point we opted not to display errors 'inline'
> because that seems to conflict with being able to edit the XML
> directly in the application.

Ah.  Yes, that makes sense.

> Please let us know if you'd like us to
> change this.

Works for me.

> Hope this is helpful -- and appreciate all the feedback,

Thank you, Mike.

In addition to the feedback on the new version given above, I'll try to
exercise it some more and give additional feedback if needed.


Best regards,

	Henrik

From henrik@levkowetz.com  Wed Aug 17 04:14:48 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 342F021F8B34 for <xml2rfc-dev@ietfa.amsl.com>; Wed, 17 Aug 2011 04:14:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.525
X-Spam-Level: 
X-Spam-Status: No, score=-102.525 tagged_above=-999 required=5 tests=[AWL=0.075, BAYES_00=-2.599, NO_RELAYS=-0.001, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TDRld7Qg3X4v for <xml2rfc-dev@ietfa.amsl.com>; Wed, 17 Aug 2011 04:14:47 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 98C9221F8B32 for <xml2rfc-dev@ietf.org>; Wed, 17 Aug 2011 04:14:47 -0700 (PDT)
Received: from brunello.autonomica.se ([2a01:3f0:1:0:21e:c2ff:fe13:7e3e]:60424 helo=brunello.netnod.se) by merlot.tools.ietf.org with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qte5p-0001vu-0P; Wed, 17 Aug 2011 13:15:29 +0200
Message-ID: <4E4BA2D0.1010101@levkowetz.com>
Date: Wed, 17 Aug 2011 13:15:28 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11
MIME-Version: 1.0
To: Mike Biglan <mike@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com>
In-Reply-To: <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com>
X-Enigmail-Version: 1.1.1
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 2a01:3f0:1:0:21e:c2ff:fe13:7e3e
X-SA-Exim-Rcpt-To: mike@concentricsky.com, xml2rfc-dev@ietf.org, jbothun@concentricsky.com, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 11:14:48 -0000

Hi Mike, Josh,


Some more feedback on the references path setting in the GUI app (on OS X).
At first, I could not make that work for me.  Here's the reason and
background:

The online references library is organized as 5 directories under a
common root:

	<<references path>>/
		bibxml/			# contains RFC references
		bibxml2/		# contains ANSI and other Std refs
		bibxml3/		# contains draft references
		bibxml4/		# contains W3C references
		bibxml5/		# contains 3GPP references

When I set the references path in the GUI app to the root of this
subtree, it didn't find my references at all; while setting it to
the specific bibxml directory which contained one of the references
I used resulted in the relevant file being found and read.  I think
we need to support recursive search for reference files so that people
can use the layout of the online library show above locally, too.


Best regards,

	Henrik

From jbothun@concentricsky.com  Thu Aug 18 11:04:48 2011
Return-Path: <jbothun@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4616B21F8AED for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:04:48 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[AWL=0.000,  BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NbNverF4C9I5 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:04:47 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id 223C521F8ACA for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 11:04:44 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 8ED1B9E8163; Thu, 18 Aug 2011 11:05:28 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id G4GFsC9Um9zr; Thu, 18 Aug 2011 11:05:23 -0700 (PDT)
Received: from [192.168.6.73] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 3BD869E8165; Thu, 18 Aug 2011 11:05:23 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Josh Bothun <jbothun@concentricsky.com>
In-Reply-To: <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com>
Date: Thu, 18 Aug 2011 11:05:20 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com>
To: Henrik Levkowetz <henrik@zinfandel.tools.ietf.org>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 18:04:48 -0000

On Aug 17, 2011, at 4:03 AM, Henrik Levkowetz wrote:

> ...
>=20
>> Specific updates to GUI App:
>>=20
>> - Batch queue removed
>> - Source document is added from File > Open Source
>> - Various new options in preferences and menus
>> - Stderr/stdout views collapsed into one view
>> - Output tabs are created/destroyed as needed
>> - Multiple lines will now be highlighted for errors
>> - Experimental support for clicking error 'links' in the console to =
jump to an error
>> - Some persistence added to application temporary settings
>> - Application takes an input file as an argument now
>> - Version bumped to 0.6.0
>=20
> The new version looks good to me so far (some comments below, though).
> Nice to see the Mac version, too :-)
>=20
> Trying this one out, there's one thing I'd like differently, related =
to
> the references library.  I'm used to being able to give a set of paths
> for this, which makes it possible for me to have all regular =
references
> in the bibxml*/ directories, while document-specific references are =
placed
> in a local ./references/ directory.  This begs two questions:
>=20
> Does the GUI version honor any environment variable which could be set
> to a list of directories (in addition to the preferences setting)?

Yes, right now the GUI application will look at the environment variable =
$XML_LIBRARY, defaulting
to /var/lib/xml2rfc if the variable is not set or the path is invalid.  =
(Is there a more appropriate
default here?).  Unless the user explicitly sets a new directory, in =
which case the application will use that.
Pressing 'reset' on that setting or 'restore to defaults' will reset the =
directory to $XML_LIBRARY.

$XML_LIBRARY is treated as a single path, however both the CLI and GUI =
could be easily modified to=20
parse it as a list of delimited directories (i believe a colon delimiter =
is the UNIX convention but comma, semicolon would work)

>=20
> Would it be possible to make the preferences setting editable as a
> text box (in addition to, or as a complement to the current file find
> dialog mechanism) and make it accept a list of places to look for a
> reference file, rather than just one?

Sure, we can make this into a list you can add/subtract from, using =
either
direct text input or by clicking a browse/add button to get a file =
dialog.  The libraries
would then be consulted in list order, so perhaps a move up/down =
function would=20
be appropriate.

-Josh



From jbothun@concentricsky.com  Thu Aug 18 11:13:38 2011
Return-Path: <jbothun@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id AE2BD21F8B4F for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:13:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[AWL=0.000,  BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id v8HiwUJRRyXP for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:13:38 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id 49EFE21F8B59 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 11:13:38 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 3FE899E8165; Thu, 18 Aug 2011 11:14:30 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XDY7YsRUqRVB; Thu, 18 Aug 2011 11:14:25 -0700 (PDT)
Received: from [192.168.6.73] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 60B9C9E8163; Thu, 18 Aug 2011 11:14:25 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Josh Bothun <jbothun@concentricsky.com>
In-Reply-To: <4E4BA2D0.1010101@levkowetz.com>
Date: Thu, 18 Aug 2011 11:14:24 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <DBD0D25E-374D-41D9-9694-C94B47F04780@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4BA2D0.1010101@levkowetz.com>
To: Henrik Levkowetz <henrik@levkowetz.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 18:13:38 -0000

Hi Henrik,

On Aug 17, 2011, at 4:15 AM, Henrik Levkowetz wrote:

> Hi Mike, Josh,
>=20
>=20
> Some more feedback on the references path setting in the GUI app (on =
OS X).
> At first, I could not make that work for me.  Here's the reason and
> background:
>=20
> The online references library is organized as 5 directories under a
> common root:
>=20
> 	<<references path>>/
> 		bibxml/			# contains RFC references
> 		bibxml2/		# contains ANSI and other Std =
refs
> 		bibxml3/		# contains draft references
> 		bibxml4/		# contains W3C references
> 		bibxml5/		# contains 3GPP references
>=20
> When I set the references path in the GUI app to the root of this
> subtree, it didn't find my references at all; while setting it to
> the specific bibxml directory which contained one of the references
> I used resulted in the relevant file being found and read.  I think
> we need to support recursive search for reference files so that people
> can use the layout of the online library show above locally, too.

Agreed, I wasn't sure how to handle that.  We'll go ahead and implement =
recursive search for a referenced file.

One question is how to handle a reference that explicitly gives one or =
more directories, such as "bibxml/reference.RFC.XXXX.xml" -- should this =
be treated as a full path and left alone, or searched recursively as =
well?  And if so, should only the basename be searched recursively, or =
the full relative path?

-Josh


From jbothun@concentricsky.com  Thu Aug 18 11:26:10 2011
Return-Path: <jbothun@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7B40411E8087 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:26:10 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[AWL=0.000,  BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6dzG2fy6pe36 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 11:26:09 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id 5950C11E8093 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 11:26:07 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 156C59E8165; Thu, 18 Aug 2011 11:27:02 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QE-2fkAYgIBH; Thu, 18 Aug 2011 11:26:57 -0700 (PDT)
Received: from [192.168.6.73] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 96AEF9E80A0; Thu, 18 Aug 2011 11:26:57 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Josh Bothun <jbothun@concentricsky.com>
In-Reply-To: <4E4BA6B0.2070500@levkowetz.com>
Date: Thu, 18 Aug 2011 11:26:56 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <851C331A-43E4-438C-946D-54B6F1DB584D@concentricsky.com>
References: <4E4520DF.60705@att.com> <4E4541FB.8010100@levkowetz.com> <C48714AE-D1FF-42C5-B3CD-F68FB9943998@concentricsky.com> <4E4BA6B0.2070500@levkowetz.com>
To: Henrik Levkowetz <henrik@levkowetz.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 18:26:10 -0000

Hi Henrik,

On Aug 17, 2011, at 4:32 AM, Henrik Levkowetz wrote:

> Hi Mike, Josh,
>=20
> Possibly there's some information missing related to the =
comments/questions
> quoted below.
>=20
> There is an online repository of references available in 5 =
subdirectories
> of a specific URL (as I mentioned in a previous email without going =
into
> the location of it, as I didn't realize that this might not be known).
> Well, the URL is this, with the listed subdirectories:
>=20
>   http://xml.resource.org/public/rfc/
> 		bibxml/			# contains RFC references
> 		bibxml2/		# contains ANSI and other Std =
refs
> 		bibxml3/		# contains draft references
> 		bibxml4/		# contains W3C references
> 		bibxml5/		# contains 3GPP references
>=20
> So given that there is one canonical URL for the online reference =
library,
> it should be possible to try to pull also a reference not specified by
> a http:// path from the internet and cache it locally, which is what I =
think
> Tony was hoping for.

We can indeed support this, but I have a couple of questions about the =
specifics of the behavior.  Namely,

1. Should the application look for the reference in online library =
before, after, or instead of looking in local library? ($XML_LIBRARY or =
otherwise explicitly set in the GUI)
2. Is the behavior for handling <!ENTITY> and <?rfc include> =
instructions identical, or are there differing rules for each?

>=20
> If you put in support for doing this, it would probably be a good idea =
to
> make the online library url configurable in the Preferences, too.
>=20
>=20

Certainly, it will likely be grouped under the 'References' tab.

-Josh

> Best regards,
>=20
> 	Henrik
>=20
>=20
>=20
> On 2011-08-17 07:32 Mike Biglan said:
>> Hi Tony,
>>=20
>> We were just hoping to clarify your note below:
>>=20
>>> "It insists on using a local citation library instead of being able =
to pull down the files over the internet. This should at least be an =
option. Another option is to pull files down from the internet to fill =
in a local cache's version of the citation library."
>>=20
>>=20
>> Our understanding is that there are two ways that an XML document can =
reference another document:
>> 	1. =46rom an <ENTITY> declaration.
>> 	2. =46rom an <?rfc include> instruction.
>>=20
>> Both of these methods have identical behavior, which is the =
following:
>>=20
>> 	- If the path requested starts with "http://", then it IS pulled =
down from the internet and cached, or loaded from the cache if it =
exists.  The citation library is not consulted.
>> 	- If the path requested does not start with "http://", then the =
filename attempts to load from the citation library (on the command line =
version, it consults environment variable $XML_LIBRARY, on the GUI =
version, there is a setting for the library location)
>> 	- Finally, if the path does not start with http:// and it was =
not found in the citation library, the document is looked for in the =
same directory as the input XML file.
>>=20
>> If this behavior is not correct then please do let us know how this =
should function and we'll get this resolved.
>>=20
>> Thanks,
>>=20
>> Mike
>>=20
>>=20
>> On Aug 12, 2011, at 8:08 AM, Henrik Levkowetz wrote:
>>=20
>>> Hi Mike,
>>>=20
>>> Enclosed are some comments from Tony on the Windows version.
>>>=20
>>>=20
>>> Best regards,
>>>=20
>>> 	Henrik
>>> <Re: Fwd: xml2rfc GUI alpha.eml>
>>=20
>>=20


From henrik@levkowetz.com  Thu Aug 18 12:46:07 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DE86B21F8C1C for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:46:07 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.274
X-Spam-Level: 
X-Spam-Status: No, score=-102.274 tagged_above=-999 required=5 tests=[AWL=-0.275, BAYES_00=-2.599, J_CHICKENPOX_21=0.6, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 64wmeiSIdwxE for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:46:07 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 4E10521F8C1B for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 12:46:07 -0700 (PDT)
Received: from 90-230-136-60-no45.tbcn.telia.com ([90.230.136.60]:54839 helo=vigonier.lan) by merlot.tools.ietf.org with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qu8Y5-0005iv-3M; Thu, 18 Aug 2011 21:46:42 +0200
Message-ID: <4E4D6C1A.2010507@levkowetz.com>
Date: Thu, 18 Aug 2011 21:46:34 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com> <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com>
In-Reply-To: <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 90.230.136.60
X-SA-Exim-Rcpt-To: jbothun@concentricsky.com, henrik@zinfandel.tools.ietf.org, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: Henrik Levkowetz <henrik@zinfandel.tools.ietf.org>, xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 19:46:08 -0000

Hi Josh,

On 2011-08-18 20:05 Josh Bothun said the following:
> On Aug 17, 2011, at 4:03 AM, Henrik Levkowetz wrote:
>
>> ...
>>
>>> Specific updates to GUI App:
>>>
>>> - Batch queue removed
>>> - Source document is added from File>  Open Source
>>> - Various new options in preferences and menus
>>> - Stderr/stdout views collapsed into one view
>>> - Output tabs are created/destroyed as needed
>>> - Multiple lines will now be highlighted for errors
>>> - Experimental support for clicking error 'links' in the console to jump to an error
>>> - Some persistence added to application temporary settings
>>> - Application takes an input file as an argument now
>>> - Version bumped to 0.6.0
>>
>> The new version looks good to me so far (some comments below, though).
>> Nice to see the Mac version, too :-)
>>
>> Trying this one out, there's one thing I'd like differently, related to
>> the references library.  I'm used to being able to give a set of paths
>> for this, which makes it possible for me to have all regular references
>> in the bibxml*/ directories, while document-specific references are placed
>> in a local ./references/ directory.  This begs two questions:
>>
>> Does the GUI version honor any environment variable which could be set
>> to a list of directories (in addition to the preferences setting)?
>
> Yes, right now the GUI application will look at the environment
> variable $XML_LIBRARY, defaulting to /var/lib/xml2rfc if the variable
> is not set or the path is invalid. (Is there a more appropriate
> default here?).

On Linux, /usr/share/xml2rfc if installed by a system installer, otherwise
/usr/local/share/xml2rfc.

I'd prefer the environment variable to reflect the program -- 'XML_LIBRARY'
is much too generic.  Please make it 'XML2RFC_LIBRARY'.

> Unless the user explicitly sets a new directory, in
> which case the application will use that. Pressing 'reset' on that
> setting or 'restore to defaults' will reset the directory to
> $XML_LIBRARY.

Ok.

> $XML_LIBRARY is treated as a single path, however both the CLI and
> GUI could be easily modified to parse it as a list of delimited
> directories (i believe a colon delimiter is the UNIX convention but
> comma, semicolon would work)

Please use colon under Un*x, semicolon under Windows.

>> Would it be possible to make the preferences setting editable as a
>> text box (in addition to, or as a complement to the current file find
>> dialog mechanism) and make it accept a list of places to look for a
>> reference file, rather than just one?
>
> Sure, we can make this into a list you can add/subtract from, using either
> direct text input or by clicking a browse/add button to get a file dialog.  The libraries
> would then be consulted in list order, so perhaps a move up/down function would
> be appropriate.

Up/down seems quite fancy; text box editing to re-order should suffice.


Best regards,

	Henrik

From henrik@levkowetz.com  Thu Aug 18 12:51:14 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8150421F8C3D for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:51:14 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.553
X-Spam-Level: 
X-Spam-Status: No, score=-102.553 tagged_above=-999 required=5 tests=[AWL=0.046, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id s0WGyWVbxl9H for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:51:14 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id CAFEC21F8C3C for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 12:51:13 -0700 (PDT)
Received: from 90-230-136-60-no45.tbcn.telia.com ([90.230.136.60]:54880 helo=vigonier.lan) by merlot.tools.ietf.org with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qu8dB-0001S4-77; Thu, 18 Aug 2011 21:51:58 +0200
Message-ID: <4E4D6D57.5060601@levkowetz.com>
Date: Thu, 18 Aug 2011 21:51:51 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4BA2D0.1010101@levkowetz.com> <DBD0D25E-374D-41D9-9694-C94B47F04780@concentricsky.com>
In-Reply-To: <DBD0D25E-374D-41D9-9694-C94B47F04780@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 90.230.136.60
X-SA-Exim-Rcpt-To: jbothun@concentricsky.com, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 19:51:14 -0000

Hi Josh,

On 2011-08-18 20:14 Josh Bothun said the following:
> Hi Henrik,
>
> On Aug 17, 2011, at 4:15 AM, Henrik Levkowetz wrote:
>
>> Hi Mike, Josh,
>>
>>
>> Some more feedback on the references path setting in the GUI app (on OS X).
>> At first, I could not make that work for me.  Here's the reason and
>> background:
>>
>> The online references library is organized as 5 directories under a
>> common root:
>>
>> 	<<references path>>/
>> 		bibxml/			# contains RFC references
>> 		bibxml2/		# contains ANSI and other Std refs
>> 		bibxml3/		# contains draft references
>> 		bibxml4/		# contains W3C references
>> 		bibxml5/		# contains 3GPP references
>>
>> When I set the references path in the GUI app to the root of this
>> subtree, it didn't find my references at all; while setting it to
>> the specific bibxml directory which contained one of the references
>> I used resulted in the relevant file being found and read.  I think
>> we need to support recursive search for reference files so that people
>> can use the layout of the online library show above locally, too.
>
> Agreed, I wasn't sure how to handle that. We'll go ahead and
> implement recursive search for a referenced file.

Excellent.

> One question is how to handle a reference that explicitly gives one
> or more directories, such as "bibxml/reference.RFC.XXXX.xml" --
> should this be treated as a full path and left alone, or searched
> recursively as well? And if so, should only the basename be searched
> recursively, or the full relative path?

If the location contains a path component, there's no recursive search,
I think.  Otherwise it becomes too magic.  If the path is relative it
refers to the references_path root (or roots, if a list of paths is
specified through environment variable or otherwise); if the path is
absolute it is used as-is.  If it's absolute and not found, the warning
could suggest that a reference with no path component, which will be
searched for in on all defined library paths, would be less prone to
break.


Best,

	Henrik


From henrik@levkowetz.com  Thu Aug 18 12:54:57 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6115311E8084 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:54:57 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.556
X-Spam-Level: 
X-Spam-Status: No, score=-102.556 tagged_above=-999 required=5 tests=[AWL=0.043, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id d5hAn1qTEh+m for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 12:54:56 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 8366A11E8073 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 12:54:56 -0700 (PDT)
Received: from 90-230-136-60-no45.tbcn.telia.com ([90.230.136.60]:54941 helo=vigonier.lan) by merlot.tools.ietf.org with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qu8gp-0001nk-It; Thu, 18 Aug 2011 21:55:44 +0200
Message-ID: <4E4D6E39.3090503@levkowetz.com>
Date: Thu, 18 Aug 2011 21:55:37 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <4E4520DF.60705@att.com> <4E4541FB.8010100@levkowetz.com> <C48714AE-D1FF-42C5-B3CD-F68FB9943998@concentricsky.com> <4E4BA6B0.2070500@levkowetz.com> <851C331A-43E4-438C-946D-54B6F1DB584D@concentricsky.com>
In-Reply-To: <851C331A-43E4-438C-946D-54B6F1DB584D@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 90.230.136.60
X-SA-Exim-Rcpt-To: jbothun@concentricsky.com, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 19:54:57 -0000

Hi Josh,

On 2011-08-18 20:26 Josh Bothun said the following:
> Hi Henrik,
>
> On Aug 17, 2011, at 4:32 AM, Henrik Levkowetz wrote:
>
>> Hi Mike, Josh,
>>
>> Possibly there's some information missing related to the comments/questions
>> quoted below.
>>
>> There is an online repository of references available in 5 subdirectories
>> of a specific URL (as I mentioned in a previous email without going into
>> the location of it, as I didn't realize that this might not be known).
>> Well, the URL is this, with the listed subdirectories:
>>
>>    http://xml.resource.org/public/rfc/
>> 		bibxml/			# contains RFC references
>> 		bibxml2/		# contains ANSI and other Std refs
>> 		bibxml3/		# contains draft references
>> 		bibxml4/		# contains W3C references
>> 		bibxml5/		# contains 3GPP references
>>
>> So given that there is one canonical URL for the online reference library,
>> it should be possible to try to pull also a reference not specified by
>> a http:// path from the internet and cache it locally, which is what I think
>> Tony was hoping for.
>
> We can indeed support this, but I have a couple of questions about
> the specifics of the behavior. Namely,
>
> 1. Should the application look for the reference in online library
> before, after, or instead of looking in local library? ($XML_LIBRARY
> or otherwise explicitly set in the GUI)

Locally first, if that fails, online (unless the reference has an
absolute path -- then it's fully defined and we don't mess with it).

> 2. Is the behavior for handling<!ENTITY> and<?rfc include>
> instructions identical, or are there differing rules for each?

I think identical, but Tony may know better.


>> If you put in support for doing this, it would probably be a good idea to
>> make the online library url configurable in the Preferences, too.
>>
>>
>
> Certainly, it will likely be grouped under the 'References' tab.

Splendid.  Thanks :-)


Best regards,

	Henrik


From tony@att.com  Thu Aug 18 13:57:24 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9270121F8B1A for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 13:57:24 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.165
X-Spam-Level: 
X-Spam-Status: No, score=-106.165 tagged_above=-999 required=5 tests=[AWL=0.434, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qWS7UHvydKCB for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 13:57:23 -0700 (PDT)
Received: from mail120.messagelabs.com (mail120.messagelabs.com [216.82.250.83]) by ietfa.amsl.com (Postfix) with ESMTP id 6BD4D21F8B17 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 13:57:23 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-2.tower-120.messagelabs.com!1313701097!33590529!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 10202 invoked from network); 18 Aug 2011 20:58:17 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-2.tower-120.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 18 Aug 2011 20:58:17 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7IKwg8d026651 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 16:58:42 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7IKwcoZ026561 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 16:58:38 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7IKwCGK004607 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 16:58:12 -0400
Received: from dns.maillennium.att.com (mailgw1.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7IKw5TQ004495 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 16:58:06 -0400
Received: from [135.70.116.68] (vpn-135-70-116-68.vpn.swst.att.com[135.70.116.68]) by maillennium.att.com (mailgw1) with ESMTP id <20110818205801gw100e4lv3e> (Authid: tony); Thu, 18 Aug 2011 20:58:04 +0000
X-Originating-IP: [135.70.116.68]
Message-ID: <4E4D7CD7.3030208@att.com>
Date: Thu, 18 Aug 2011 16:57:59 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:6.0) Gecko/20110812 Thunderbird/6.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com> <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com>
In-Reply-To: <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Henrik Levkowetz <henrik@zinfandel.tools.ietf.org>, xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 20:57:24 -0000

On 8/18/2011 2:05 PM, Josh Bothun wrote:
> On Aug 17, 2011, at 4:03 AM, Henrik Levkowetz wrote:
>
>> ...
>>
>>> Specific updates to GUI App:
>>>
>>> - Batch queue removed
>>> - Source document is added from File>  Open Source
>>> - Various new options in preferences and menus
>>> - Stderr/stdout views collapsed into one view
>>> - Output tabs are created/destroyed as needed
>>> - Multiple lines will now be highlighted for errors
>>> - Experimental support for clicking error 'links' in the console to jump to an error
>>> - Some persistence added to application temporary settings
>>> - Application takes an input file as an argument now
>>> - Version bumped to 0.6.0
>> The new version looks good to me so far (some comments below, though).
>> Nice to see the Mac version, too :-)
>>
>> Trying this one out, there's one thing I'd like differently, related to
>> the references library.  I'm used to being able to give a set of paths
>> for this, which makes it possible for me to have all regular references
>> in the bibxml*/ directories, while document-specific references are placed
>> in a local ./references/ directory.  This begs two questions:
>>
>> Does the GUI version honor any environment variable which could be set
>> to a list of directories (in addition to the preferences setting)?
> Yes, right now the GUI application will look at the environment variable $XML_LIBRARY, defaulting
> to /var/lib/xml2rfc if the variable is not set or the path is invalid.  (Is there a more appropriate
> default here?).  Unless the user explicitly sets a new directory, in which case the application will use that.
> Pressing 'reset' on that setting or 'restore to defaults' will reset the directory to $XML_LIBRARY.
>
> $XML_LIBRARY is treated as a single path, however both the CLI and GUI could be easily modified to
> parse it as a list of delimited directories (i believe a colon delimiter is the UNIX convention but comma, semicolon would work)

The problems I've been having have also been due to the references library.

(For purposes of exposition, I'm going to refer to the existing tcl 
version as xml2rfc1, and the new one as xml2rfc2.)

This is one area where we absolutely must be compatible with xml2rfc1 to 
begin with.

The value of $XML_LIBRARY needs to be treated as a path. For unix/mac 
systems, it needs to use ":" as the delimiter. For Windows systems, it 
needs to use ";" as the delimiter. That's it -- nothing else. A trailing 
delimiter, leading delimiter or two delimiters next to each other 
indicates the "current directory" is to be looked in at that point. I 
suggest that "current directory" should mean the "directory of the 
document being converted".

You say that it defaults to /var/lib/xml2rfc, whereas it appears to 
instead default to a path of /var/lib/xml2rfc PLUS the directory of the 
document: For example, here is a warning message I got when my document 
was in the My Documents/ietf directory.

     WARNING: Include file not found: C:/Documents and 
Settings/Administrator/My
     Documents/ietf\reference.RFC.2119.xml

If I put the reference.RFC.2119.xml file in *either* place, xml2rfc2 
finds the reference file.

BTW, these WARNING messages are not clickable, whereas the subsequent 
but useless IDREF attribute message *is* clickable.

xml2rfc1 does not do any sort of depth-first search -- I'm not convinced 
we should do that in xml2rfc2 to begin with.

For what it's worth, I don't like that it's writing the converted files 
in the same place where it's looking for the references. It would be 
better to write the converted files in the same directory as the source.


>> Would it be possible to make the preferences setting editable as a
>> text box (in addition to, or as a complement to the current file find
>> dialog mechanism) and make it accept a list of places to look for a
>> reference file, rather than just one?
> Sure, we can make this into a list you can add/subtract from, using either
> direct text input or by clicking a browse/add button to get a file dialog.  The libraries
> would then be consulted in list order, so perhaps a move up/down function would
> be appropriate.

After you make the preferences a path, I suggest you use 
"/var/lib/xml2rfc:" as the default setting. (Yes, that's a trailing 
delimiter there.)

Some other suggestions:

Until there's a "save file" option, the XML page should not be modifiable.

When the file *has* been modified, there should be an indication (like a 
"*" by "XML" in the tab) to visibly indicate that it has been modified. 
Saving the file of course would clear that "*".



On 8/18/2011 2:14 PM, Josh Bothun wrote:
> Hi Henrik,
>
> On Aug 17, 2011, at 4:15 AM, Henrik Levkowetz wrote:
>> Hi Mike, Josh,
>>
>> Some more feedback on the references path setting in the GUI app (on OS X).
>> At first, I could not make that work for me.  Here's the reason and
>> background:
>>
>> The online references library is organized as 5 directories under a
>> common root:
>>
>> 	<<references path>>/
>> 		bibxml/			# contains RFC references
>> 		bibxml2/		# contains ANSI and other Std refs
>> 		bibxml3/		# contains draft references
>> 		bibxml4/		# contains W3C references
>> 		bibxml5/		# contains 3GPP references
>>
>> When I set the references path in the GUI app to the root of this
>> subtree, it didn't find my references at all; while setting it to
>> the specific bibxml directory which contained one of the references
>> I used resulted in the relevant file being found and read.  I think
>> we need to support recursive search for reference files so that people
>> can use the layout of the online library show above locally, too.
> Agreed, I wasn't sure how to handle that.  We'll go ahead and implement recursive search for a referenced file.
>
> One question is how to handle a reference that explicitly gives one or more directories, such as "bibxml/reference.RFC.XXXX.xml" -- should this be treated as a full path and left alone, or searched recursively as well?  And if so, should only the basename be searched recursively, or the full relative path?

I think xml2rfc1 ignores the partial path. But it also does *not* do a 
recursive search -- instead it expects each of the bibxml* directories 
to be listed separately.



On 8/18/2011 2:26 PM, Josh Bothun wrote:
> Hi Henrik,
> On Aug 17, 2011, at 4:32 AM, Henrik Levkowetz wrote:
>> Hi Mike, Josh,
>>
>> Possibly there's some information missing related to the comments/questions
>> quoted below.
>>
>> There is an online repository of references available in 5 subdirectories
>> of a specific URL (as I mentioned in a previous email without going into
>> the location of it, as I didn't realize that this might not be known).
>> Well, the URL is this, with the listed subdirectories:
>>
>>    http://xml.resource.org/public/rfc/
>> 		bibxml/			# contains RFC references
>> 		bibxml2/		# contains ANSI and other Std refs
>> 		bibxml3/		# contains draft references
>> 		bibxml4/		# contains W3C references
>> 		bibxml5/		# contains 3GPP references
>>
>> So given that there is one canonical URL for the online reference library,
>> it should be possible to try to pull also a reference not specified by
>> a http:// path from the internet and cache it locally, which is what I think
>> Tony was hoping for.
> We can indeed support this, but I have a couple of questions about the specifics of the behavior.  Namely,
>
> 1. Should the application look for the reference in online library before, after, or instead of looking in local library? ($XML_LIBRARY or otherwise explicitly set in the GUI)

How about treating "network" as another option in the list of 
directories to search?

Note: xml2rfc1 always searches the network *last*.

> 2. Is the behavior for handling<!ENTITY>  and<?rfc include>  instructions identical, or are there differing rules for each?

 From what I can tell in xml2rfc1, <!ENTITY SYSTEM>, <!ENTITY PUBLIC> 
and <?rfc include> are treated identically as far as searching for the file.

>> If you put in support for doing this, it would probably be a good idea to
>> make the online library url configurable in the Preferences, too.
> Certainly, it will likely be grouped under the 'References' tab.

Hope these comments are useful.

     Tony

From henrik@levkowetz.com  Thu Aug 18 14:18:35 2011
Return-Path: <henrik@levkowetz.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A80FB21F85B1 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 14:18:35 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -102.562
X-Spam-Level: 
X-Spam-Status: No, score=-102.562 tagged_above=-999 required=5 tests=[AWL=0.037, BAYES_00=-2.599, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SihSZKI+GJqm for <xml2rfc-dev@ietfa.amsl.com>; Thu, 18 Aug 2011 14:18:34 -0700 (PDT)
Received: from merlot.tools.ietf.org (unknown [IPv6:2a01:3f0:0:31:214:22ff:fe21:bb]) by ietfa.amsl.com (Postfix) with ESMTP id 4E30121F8574 for <xml2rfc-dev@ietf.org>; Thu, 18 Aug 2011 14:18:34 -0700 (PDT)
Received: from 90-230-136-60-no45.tbcn.telia.com ([90.230.136.60]:56276 helo=vigonier.lan) by merlot.tools.ietf.org with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.75) (envelope-from <henrik@levkowetz.com>) id 1Qu9zd-0003fx-8j; Thu, 18 Aug 2011 23:19:15 +0200
Message-ID: <4E4D81CA.30800@levkowetz.com>
Date: Thu, 18 Aug 2011 23:19:06 +0200
From: Henrik Levkowetz <henrik@levkowetz.com>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Tony Hansen <tony@att.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com> <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com> <4E4D7CD7.3030208@att.com>
In-Reply-To: <4E4D7CD7.3030208@att.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-SA-Exim-Connect-IP: 90.230.136.60
X-SA-Exim-Rcpt-To: tony@att.com, jbothun@concentricsky.com, henrik@zinfandel.tools.ietf.org, xml2rfc-dev@ietf.org, henrik-sent@levkowetz.com
X-SA-Exim-Mail-From: henrik@levkowetz.com
X-SA-Exim-Version: 4.2.1 (built Mon, 22 Mar 2010 06:51:10 +0000)
X-SA-Exim-Scanned: Yes (on merlot.tools.ietf.org)
Cc: Henrik Levkowetz <henrik@zinfandel.tools.ietf.org>, xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 21:18:35 -0000

Hi Tony,

A few points of discussion, inline.  Some text snipped:

On 2011-08-18 22:57 Tony Hansen said the following:

...

>> $XML_LIBRARY is treated as a single path, however both the CLI and GUI could be easily modified to
>> parse it as a list of delimited directories (i believe a colon delimiter is the UNIX convention but comma, semicolon would work)
>
> The problems I've been having have also been due to the references library.
>
> (For purposes of exposition, I'm going to refer to the existing tcl
> version as xml2rfc1, and the new one as xml2rfc2.)
>
> This is one area where we absolutely must be compatible with xml2rfc1 to
> begin with.
>
> The value of $XML_LIBRARY needs to be treated as a path.

And if xml2rfc1 understood $XML_LIBRARY, we need to continue to do so.
I'd still prefer that the docs suggested that people use $XML2RFC_LIBRARY
going forward, I still think $XML_LIBRARY is much to generic.

> For unix/mac
> systems, it needs to use ":" as the delimiter. For Windows systems, it
> needs to use ";" as the delimiter. That's it -- nothing else. A trailing
> delimiter, leading delimiter or two delimiters next to each other
> indicates the "current directory" is to be looked in at that point. I
> suggest that "current directory" should mean the "directory of the
> document being converted".
>
> You say that it defaults to /var/lib/xml2rfc, whereas it appears to
> instead default to a path of /var/lib/xml2rfc PLUS the directory of the
> document: For example, here is a warning message I got when my document
> was in the My Documents/ietf directory.
>
>       WARNING: Include file not found: C:/Documents and
> Settings/Administrator/My
>       Documents/ietf\reference.RFC.2119.xml
>
> If I put the reference.RFC.2119.xml file in *either* place, xml2rfc2
> finds the reference file.
>
> BTW, these WARNING messages are not clickable, whereas the subsequent
> but useless IDREF attribute message *is* clickable.

Earlier I suggested that the appropriate default be /usr/share/xml2rfc,
rather than /var/lib/xml2rfc -- this is the correct place according to
the Filesystem Hierarchy Standard (http://www.pathname.com/fhs/) so we
should try to make it so if at all possible.

> xml2rfc1 does not do any sort of depth-first search -- I'm not convinced
> we should do that in xml2rfc2 to begin with.

Hmm.  I'd prefer to have that -- I've been annoyed by the lack of it
before -- but if you feel strongly about this then let's skip it for
now.

> For what it's worth, I don't like that it's writing the converted files
> in the same place where it's looking for the references. It would be
> better to write the converted files in the same directory as the source.

?!?  I haven't seen this behaviour -- my recent tests saw it put the
converted file with the source.

...

>> Sure, we can make this into a list you can add/subtract from, using either
>> direct text input or by clicking a browse/add button to get a file dialog.  The libraries
>> would then be consulted in list order, so perhaps a move up/down function would
>> be appropriate.
>
> After you make the preferences a path, I suggest you use
> "/var/lib/xml2rfc:" as the default setting. (Yes, that's a trailing
> delimiter there.)

See above -- I'd suggest '/usr/share/xml2rfc:' in that case.

> Some other suggestions:
>
> Until there's a "save file" option, the XML page should not be modifiable.

Yes, I thought about the 'save' option, too.  Agreed.

> When the file *has* been modified, there should be an indication (like a
> "*" by "XML" in the tab) to visibly indicate that it has been modified.
> Saving the file of course would clear that "*".

Good point.


Best regards,

	Henrik



>
> On 8/18/2011 2:14 PM, Josh Bothun wrote:
>> Hi Henrik,
>>
>> On Aug 17, 2011, at 4:15 AM, Henrik Levkowetz wrote:
>>> Hi Mike, Josh,
>>>
>>> Some more feedback on the references path setting in the GUI app (on OS X).
>>> At first, I could not make that work for me.  Here's the reason and
>>> background:
>>>
>>> The online references library is organized as 5 directories under a
>>> common root:
>>>
>>> 	<<references path>>/
>>> 		bibxml/			# contains RFC references
>>> 		bibxml2/		# contains ANSI and other Std refs
>>> 		bibxml3/		# contains draft references
>>> 		bibxml4/		# contains W3C references
>>> 		bibxml5/		# contains 3GPP references
>>>
>>> When I set the references path in the GUI app to the root of this
>>> subtree, it didn't find my references at all; while setting it to
>>> the specific bibxml directory which contained one of the references
>>> I used resulted in the relevant file being found and read.  I think
>>> we need to support recursive search for reference files so that people
>>> can use the layout of the online library show above locally, too.
>> Agreed, I wasn't sure how to handle that.  We'll go ahead and implement recursive search for a referenced file.
>>
>> One question is how to handle a reference that explicitly gives one or more directories, such as "bibxml/reference.RFC.XXXX.xml" -- should this be treated as a full path and left alone, or searched recursively as well?  And if so, should only the basename be searched recursively, or the full relative path?
>
> I think xml2rfc1 ignores the partial path. But it also does *not* do a
> recursive search -- instead it expects each of the bibxml* directories
> to be listed separately.
>
>
>
> On 8/18/2011 2:26 PM, Josh Bothun wrote:
>> Hi Henrik,
>> On Aug 17, 2011, at 4:32 AM, Henrik Levkowetz wrote:
>>> Hi Mike, Josh,
>>>
>>> Possibly there's some information missing related to the comments/questions
>>> quoted below.
>>>
>>> There is an online repository of references available in 5 subdirectories
>>> of a specific URL (as I mentioned in a previous email without going into
>>> the location of it, as I didn't realize that this might not be known).
>>> Well, the URL is this, with the listed subdirectories:
>>>
>>>     http://xml.resource.org/public/rfc/
>>> 		bibxml/			# contains RFC references
>>> 		bibxml2/		# contains ANSI and other Std refs
>>> 		bibxml3/		# contains draft references
>>> 		bibxml4/		# contains W3C references
>>> 		bibxml5/		# contains 3GPP references
>>>
>>> So given that there is one canonical URL for the online reference library,
>>> it should be possible to try to pull also a reference not specified by
>>> a http:// path from the internet and cache it locally, which is what I think
>>> Tony was hoping for.
>> We can indeed support this, but I have a couple of questions about the specifics of the behavior.  Namely,
>>
>> 1. Should the application look for the reference in online library before, after, or instead of looking in local library? ($XML_LIBRARY or otherwise explicitly set in the GUI)
>
> How about treating "network" as another option in the list of
> directories to search?
>
> Note: xml2rfc1 always searches the network *last*.
>
>> 2. Is the behavior for handling<!ENTITY>   and<?rfc include>   instructions identical, or are there differing rules for each?
>
>    From what I can tell in xml2rfc1,<!ENTITY SYSTEM>,<!ENTITY PUBLIC>
> and<?rfc include>  are treated identically as far as searching for the file.
>
>>> If you put in support for doing this, it would probably be a good idea to
>>> make the online library url configurable in the Preferences, too.
>> Certainly, it will likely be grouped under the 'References' tab.
>
> Hope these comments are useful.
>
>       Tony
> _______________________________________________
> xml2rfc-dev mailing list
> xml2rfc-dev@ietf.org
> https://www.ietf.org/mailman/listinfo/xml2rfc-dev
>

From mike@concentricsky.com  Wed Aug 24 10:28:52 2011
Return-Path: <mike@concentricsky.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3A67021F8AFF for <xml2rfc-dev@ietfa.amsl.com>; Wed, 24 Aug 2011 10:28:52 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.265
X-Spam-Level: 
X-Spam-Status: No, score=-2.265 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, IP_NOT_FRIENDLY=0.334]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HR3wy7vcMNqB for <xml2rfc-dev@ietfa.amsl.com>; Wed, 24 Aug 2011 10:28:51 -0700 (PDT)
Received: from locust.concentricsky.com (locust.concentricsky.com [69.30.54.148]) by ietfa.amsl.com (Postfix) with ESMTP id 890A321F85C0 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 10:28:51 -0700 (PDT)
Received: from localhost (localhost.localdomain [127.0.0.1]) by locust.concentricsky.com (Postfix) with ESMTP id 3B47C9E80C9; Wed, 24 Aug 2011 10:29:55 -0700 (PDT)
Received: from locust.concentricsky.com ([127.0.0.1]) by localhost (locust.concentricsky.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wvhEi-M+2plI; Wed, 24 Aug 2011 10:29:51 -0700 (PDT)
Received: from [192.168.6.157] (caterpillar.concentricsky.com [74.95.42.1]) by locust.concentricsky.com (Postfix) with ESMTP id 306679E80C7; Wed, 24 Aug 2011 10:29:51 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Mike Biglan <mike@concentricsky.com>
In-Reply-To: <4E4D81CA.30800@levkowetz.com>
Date: Wed, 24 Aug 2011 10:29:53 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com> <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com> <4E4D7CD7.3030208@att.com> <4E4D81CA.30800@levkowetz.com>
To: Henrik Levkowetz <henrik@levkowetz.com>
X-Mailer: Apple Mail (2.1084)
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 17:28:52 -0000

Hi All,

Some updates from our modifications from last week below for both the =
command-line tool and the GUI applications.


Command Line Tool - xml2rfc version 2.2:
=3D=3D=3D=3D=3D=3D=3D

1) IREF rendering improved

2) External reference resolution has been overhauled and is =
significantly more robust. Recent comments from Tony/Henrik have been =
taken into consideration. Let us know if you'd like us to provide a =
separate email with pseudocode description of the resolution algorithm =
-- it can be found in a docstring of cli/xml2rfc/parser.py at line 100.=20=


In a nutshell:
- Absolute paths are treated as-is.
- Non-absolute paths are searched in the following order: (a) Local =
locations (b) Network location, automatically caching (c) Source =
directory
	Where "Local locations" is a list of directories in =
$XML_LIBRARY, defaulting to '/usr/share/xml2rfc:', and "Network =
Location" is "http://xml.resource.org/public/rfc/", both "Local =
locations" and "Network Location" are modifiable in the GUI, but have =
the same defaults as the CLI.
- Filenames with no path component are NOT searched for recursively, but =
I am ready to implement this if needed.
=09
3) Due to the complexity of how references are resolved, they get their =
own exception layer. The application will now properly halt on =
unresolved references, and error messages should be much clearer now.  =
If --verbose was used, xml2rfc will tell you all the locations it looked =
for a reference before failing.  I believe this should greatly improve =
our ability to troubleshoot some of the problems through community =
testing, and cross-platform testing.



GUI - xml2rfc-gui version 0.7.1:
=3D=3D=3D=3D=3D=3D=3D

1) Editing/Saving of XML source file implemented, as long as file is not =
read-only.  A modified document will contain an asterisk (*) next to its =
title in the editor

2) Configurable list of local libraries and network library in =
Preferences > References.

3) Brought up to speed with new reference resolution / errors in core =
library

4) Minor cosmetic tweaks

Here are new permalinks to the built application:

Windows: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-win32.zip
OS X: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-osx.zip
Debian: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-debian.zip

DEBIAN PACKAGE NOTE: It is installed as "dpkg -i <file>.deb".   If there =
are any dependency issues, running sudo apt-get -f install will resolve =
them.  In a real repository, such as installing xml2rfc-gui from =
apt-get, these dependencies would be resolved automatically.  Although =
the file is currently labeled python-xml2rfc-gui.deb, the application is =
invoked as "xml2rfc-gui"


We'll go back through the latest email thread and directly respond to =
any unresolved sub-thread.

Thanks for the input and talk with you all soon,

Mike=

From tony@att.com  Wed Aug 24 12:06:27 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5C3D721F8BF9 for <xml2rfc-dev@ietfa.amsl.com>; Wed, 24 Aug 2011 12:06:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.198
X-Spam-Level: 
X-Spam-Status: No, score=-106.198 tagged_above=-999 required=5 tests=[AWL=0.401, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id s7xvpjpzCbG7 for <xml2rfc-dev@ietfa.amsl.com>; Wed, 24 Aug 2011 12:06:26 -0700 (PDT)
Received: from mail119.messagelabs.com (mail119.messagelabs.com [216.82.241.195]) by ietfa.amsl.com (Postfix) with ESMTP id CE01B21F8876 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 12:06:25 -0700 (PDT)
X-Env-Sender: tony@att.com
X-Msg-Ref: server-8.tower-119.messagelabs.com!1314212855!35674180!1
X-Originating-IP: [144.160.20.145]
X-StarScan-Version: 6.3.6; banners=-,-,-
X-VirusChecked: Checked
Received: (qmail 11020 invoked from network); 24 Aug 2011 19:07:35 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-8.tower-119.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 24 Aug 2011 19:07:35 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7OJ80Hv001415 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 15:08:01 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7OJ7wkE001289 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 15:07:58 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7OJ7Wj9028012 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 15:07:32 -0400
Received: from dns.maillennium.att.com (dns.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7OJ7T5c027920 for <xml2rfc-dev@ietf.org>; Wed, 24 Aug 2011 15:07:30 -0400
Received: from [135.70.161.116] (vpn-135-70-161-116.vpn.mwst.att.com[135.70.161.116]) by maillennium.att.com (mailgw1) with ESMTP id <20110824190722gw100e4lace> (Authid: tony); Wed, 24 Aug 2011 19:07:28 +0000
X-Originating-IP: [135.70.161.116]
Message-ID: <4E554BDD.9090804@att.com>
Date: Wed, 24 Aug 2011 15:07:09 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:6.0) Gecko/20110812 Thunderbird/6.0
MIME-Version: 1.0
To: Mike Biglan <mike@concentricsky.com>
References: <68972A73-B2B6-4A3E-89AC-E904373EA7EF@concentricsky.com> <FDD4F9C4-B19A-4CC6-A465-7064A4B40687@concentricsky.com> <4E491366.7060503@levkowetz.com> <84C653C4-E879-4E46-878B-F32C563CEA43@concentricsky.com> <4E4B9FFC.5060704@levkowetz.com> <8E82E32D-5E75-4272-BFF4-BF56BE247D22@concentricsky.com> <41154634-7B07-4BD9-8771-171E28D440CF@concentricsky.com> <4E4D7CD7.3030208@att.com> <4E4D81CA.30800@levkowetz.com> <8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com>
In-Reply-To: <8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com>
Content-Type: multipart/alternative; boundary="------------070608030004050801040902"
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] xml2rfc GUI alpha
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 19:06:27 -0000

This is a multi-part message in MIME format.
--------------070608030004050801040902
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Thanks Mike.

more below

         Tony

On 8/24/2011 1:29 PM, Mike Biglan wrote:
> Hi All,
>
> Some updates from our modifications from last week below for both the command-line tool and the GUI applications.
>
>
> Command Line Tool - xml2rfc version 2.2:
> =======
>
> 1) IREF rendering improved
>
> 2) External reference resolution has been overhauled and is significantly more robust. Recent comments from Tony/Henrik have been taken into consideration. Let us know if you'd like us to provide a separate email with pseudocode description of the resolution algorithm -- it can be found in a docstring of cli/xml2rfc/parser.py at line 100.
>
> In a nutshell:
> - Absolute paths are treated as-is.
> - Non-absolute paths are searched in the following order: (a) Local locations (b) Network location, automatically caching (c) Source directory
> 	Where "Local locations" is a list of directories in $XML_LIBRARY, defaulting to '/usr/share/xml2rfc:', and "Network Location" is "http://xml.resource.org/public/rfc/", both "Local locations" and "Network Location" are modifiable in the GUI, but have the same defaults as the CLI.

I like how this is shaping up. Is there a command line option that 
controls whether the network is consulted?

> - Filenames with no path component are NOT searched for recursively, but I am ready to implement this if needed.
> 	
> 3) Due to the complexity of how references are resolved, they get their own exception layer. The application will now properly halt on unresolved references, and error messages should be much clearer now.  If --verbose was used, xml2rfc will tell you all the locations it looked for a reference before failing.  I believe this should greatly improve our ability to troubleshoot some of the problems through community testing, and cross-platform testing.

I like the --verbose option.

> GUI - xml2rfc-gui version 0.7.1:
> =======
>
> 1) Editing/Saving of XML source file implemented, as long as file is not read-only.  A modified document will contain an asterisk (*) next to its title in the editor
>
> 2) Configurable list of local libraries and network library in Preferences>  References.
>
> 3) Brought up to speed with new reference resolution / errors in core library
>
> 4) Minor cosmetic tweaks

These all sound good.

I like what I see!! A definite improvement.

Some feedback.

1) when run from the command line, it should put itself in the background.

2) we need a nice logo for it. :-)

3) I made some changes to the XML, clicked on Convert, and it silently 
threw the changes away. Some possible options:

     a)    automatically save the changes

     b)    prompt whether to save the changes or discard the changes 
before converting

I like (b) a bit better.

4) Where it displays resolving a reference that was retrieved over the 
net, I see:

     Resolving include... 
\var\cache\xml2rfc\_HTTP_CACHE\reference.RFC.2049.xml

I would have expected to see something like

     Resolving include... 
http://xml.resource.org/public/rfc/bibxml/reference.RFC.2049.xml
     Caching in \var\cache\xml2rfc\_HTTP_CACHE\reference.RFC.2049.xml

5) Errors resolving includes don't have a pointer back into the document.

6) I changed a </references> to </referencesx> and got the expected 
error message:

     Line 682: expected '>', line 682, column 7

However, the actual error was on line 680 instead of 682.


Keep up the good work!

     Tony

> Here are new permalinks to the built application:
>
> Windows: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-win32.zip
> OS X: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-osx.zip
> Debian: http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-debian.zip
>
> DEBIAN PACKAGE NOTE: It is installed as "dpkg -i<file>.deb".   If there are any dependency issues, running sudo apt-get -f install will resolve them.  In a real repository, such as installing xml2rfc-gui from apt-get, these dependencies would be resolved automatically.  Although the file is currently labeled python-xml2rfc-gui.deb, the application is invoked as "xml2rfc-gui"
>
>
> We'll go back through the latest email thread and directly respond to any unresolved sub-thread.
>
> Thanks for the input and talk with you all soon,
>
> Mike

--------------070608030004050801040902
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Thanks Mike.<br>
    <br>
    more below<br>
    <br>
            Tony<br>
    <br>
    On 8/24/2011 1:29 PM, Mike Biglan wrote:
    <blockquote
      cite="mid:8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com"
      type="cite">
      <pre wrap="">Hi All,

Some updates from our modifications from last week below for both the command-line tool and the GUI applications.


Command Line Tool - xml2rfc version 2.2:
=======

1) IREF rendering improved

2) External reference resolution has been overhauled and is significantly more robust. Recent comments from Tony/Henrik have been taken into consideration. Let us know if you'd like us to provide a separate email with pseudocode description of the resolution algorithm -- it can be found in a docstring of cli/xml2rfc/parser.py at line 100. 

In a nutshell:
- Absolute paths are treated as-is.
- Non-absolute paths are searched in the following order: (a) Local locations (b) Network location, automatically caching (c) Source directory
	Where "Local locations" is a list of directories in $XML_LIBRARY, defaulting to '/usr/share/xml2rfc:', and "Network Location" is <a class="moz-txt-link-rfc2396E" href="http://xml.resource.org/public/rfc/">"http://xml.resource.org/public/rfc/"</a>, both "Local locations" and "Network Location" are modifiable in the GUI, but have the same defaults as the CLI.</pre>
    </blockquote>
    <br>
    I like how this is shaping up. Is there a command line option that
    controls whether the network is consulted?<br>
    <br>
    <blockquote
      cite="mid:8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com"
      type="cite">
      <pre wrap="">- Filenames with no path component are NOT searched for recursively, but I am ready to implement this if needed.
	
3) Due to the complexity of how references are resolved, they get their own exception layer. The application will now properly halt on unresolved references, and error messages should be much clearer now.  If --verbose was used, xml2rfc will tell you all the locations it looked for a reference before failing.  I believe this should greatly improve our ability to troubleshoot some of the problems through community testing, and cross-platform testing.</pre>
    </blockquote>
    <br>
    I like the --verbose option.<br>
    <br>
    <blockquote
      cite="mid:8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com"
      type="cite">
      <pre wrap="">GUI - xml2rfc-gui version 0.7.1:
=======

1) Editing/Saving of XML source file implemented, as long as file is not read-only.  A modified document will contain an asterisk (*) next to its title in the editor

2) Configurable list of local libraries and network library in Preferences &gt; References.

3) Brought up to speed with new reference resolution / errors in core library

4) Minor cosmetic tweaks</pre>
    </blockquote>
    <br>
    These all sound good. <br>
    <br>
    I like what I see!! A definite improvement.<br>
    <br>
    Some feedback.<br>
    <br>
    1) when run from the command line, it should put itself in the
    background.<br>
    <br>
    2) we need a nice logo for it. :-)<br>
    <br>
    3) I made some changes to the XML, clicked on Convert, and it
    silently threw the changes away. Some possible options:<br>
    <br>
        a)    automatically save the changes<br>
    <br>
        b)    prompt whether to save the changes or discard the changes
    before converting<br>
    <br>
    I like (b) a bit better.<br>
    <br>
    4) Where it displays resolving a reference that was retrieved over
    the net, I see:<br>
    <br>
    <span style=" color:#000000;">    Resolving include...
      \var\cache\xml2rfc\_HTTP_CACHE\reference.RFC.2049.xml</span><br>
    <br>
    I would have expected to see something like<br>
    <br>
        Resolving include...
    <a class="moz-txt-link-freetext" href="http://xml.resource.org/public/rfc/bibxml/reference.RFC.2049.xml">http://xml.resource.org/public/rfc/bibxml/reference.RFC.2049.xml</a><br>
        Caching in <span style=" color:#000000;">\var\cache\xml2rfc\_HTTP_CACHE\reference.RFC.2049.xml</span><br>
    <br>
    5) Errors resolving includes don't have a pointer back into the
    document.<br>
    <br>
    6) I changed a &lt;/references&gt; to &lt;/referencesx&gt; and got
    the expected error message:<br>
    <br>
        Line 682: expected '&gt;', line 682, column 7<br>
    <br>
    However, the actual error was on line 680 instead of 682.<br>
    <br>
    <br>
    Keep up the good work!<br>
         <br>
        Tony   <br>
    <br>
    <blockquote
      cite="mid:8FD102AD-43D6-41F6-BF1D-738E2E008C27@concentricsky.com"
      type="cite">
      <pre wrap="">Here are new permalinks to the built application:

Windows: <a class="moz-txt-link-freetext" href="http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-win32.zip">http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-win32.zip</a>
OS X: <a class="moz-txt-link-freetext" href="http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-osx.zip">http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-osx.zip</a>
Debian: <a class="moz-txt-link-freetext" href="http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-debian.zip">http://minornine.com/xml2rfc/xml2rfc-gui-0.7.1-debian.zip</a>

DEBIAN PACKAGE NOTE: It is installed as "dpkg -i &lt;file&gt;.deb".   If there are any dependency issues, running sudo apt-get -f install will resolve them.  In a real repository, such as installing xml2rfc-gui from apt-get, these dependencies would be resolved automatically.  Although the file is currently labeled python-xml2rfc-gui.deb, the application is invoked as "xml2rfc-gui"


We'll go back through the latest email thread and directly respond to any unresolved sub-thread.

Thanks for the input and talk with you all soon,

Mike
</pre>
    </blockquote>
  </body>
</html>

--------------070608030004050801040902--

From tony@att.com  Thu Aug 25 14:48:40 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 17D6921F8C95 for <xml2rfc-dev@ietfa.amsl.com>; Thu, 25 Aug 2011 14:48:40 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.208
X-Spam-Level: 
X-Spam-Status: No, score=-106.208 tagged_above=-999 required=5 tests=[AWL=0.391, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id seVlXX62A2Cs for <xml2rfc-dev@ietfa.amsl.com>; Thu, 25 Aug 2011 14:48:39 -0700 (PDT)
Received: from mail120.messagelabs.com (mail120.messagelabs.com [216.82.250.83]) by ietfa.amsl.com (Postfix) with ESMTP id 4F44C21F8C9A for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 14:48:39 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-10.tower-120.messagelabs.com!1314308992!34726930!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 6830 invoked from network); 25 Aug 2011 21:49:53 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-10.tower-120.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 25 Aug 2011 21:49:53 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7PLoIBC001169 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 17:50:18 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7PLoHpd001161 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 17:50:17 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7PLnomV009202 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 17:49:50 -0400
Received: from dns.maillennium.att.com (dns.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7PLngnf009043 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 17:49:46 -0400
Received: from [135.70.120.55] (vpn-135-70-120-55.vpn.swst.att.com[135.70.120.55]) by maillennium.att.com (mailgw1) with ESMTP id <20110825214941gw100e4leee> (Authid: tony); Thu, 25 Aug 2011 21:49:42 +0000
X-Originating-IP: [135.70.120.55]
Message-ID: <4E56C369.6090201@att.com>
Date: Thu, 25 Aug 2011 17:49:29 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:6.0) Gecko/20110812 Thunderbird/6.0
MIME-Version: 1.0
To: jbothun@concentricsky.com
References: <E1QwhM9-0004E1-F7@zinfandel.tools.ietf.org>
In-Reply-To: <E1QwhM9-0004E1-F7@zinfandel.tools.ietf.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] [svnhook] Svn commit to tools/xml2rfc
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Thu, 25 Aug 2011 21:48:40 -0000

I installed this version on xml.resource.org.

I'm having a problem getting it to find external references when invoked 
from the web (http://xml.resource.org/experimental.html).

Try sending it draft-ietf-iri-4395bis-irireg-03.xml

I printed out the value of $XML_LIBRARY to help debug this.

Are there additional options I can invoke xml2rfc2 with (in addition to 
--verbose) that will tell us *where* it's looking for its references?

Also, it doesn't appear that xml2rfc is exiting with an error code when 
it cannot parse the file. Please add an exit non-zero (e.g. 1) or its 
equivalent for any failures.

     Tony

On 8/25/2011 5:20 PM, www-data wrote:
> jbothun@concentricsky.com has made a new SVN commit in
> tools/xml2rfc/version2 [524]:
>
> Caching resolver will print both URL and cache locations if --verbose
>
> "Index" section skipped if no irefs are registered
>
> Svn:  http://svn.tools.ietf.org/svn/tools/xml2rfc//version2
> Trac: http://trac.tools.ietf.org/tools/xml2rfc/trac//changeset/524/version2
>
> Files:
>
> U   version2/cli/xml2rfc/parser.py
> U   version2/cli/xml2rfc/writers/base.py
> U   version2/cli/xml2rfc/writers/paginated_txt.py
>

From tony@att.com  Thu Aug 25 18:42:33 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F3F3B21F856A for <xml2rfc-dev@ietfa.amsl.com>; Thu, 25 Aug 2011 18:42:32 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.217
X-Spam-Level: 
X-Spam-Status: No, score=-106.217 tagged_above=-999 required=5 tests=[AWL=0.381, BAYES_00=-2.599, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ro--Gnq++s-U for <xml2rfc-dev@ietfa.amsl.com>; Thu, 25 Aug 2011 18:42:32 -0700 (PDT)
Received: from mail119.messagelabs.com (mail119.messagelabs.com [216.82.241.195]) by ietfa.amsl.com (Postfix) with ESMTP id AC2D521F8562 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 18:42:31 -0700 (PDT)
X-Env-Sender: tony@att.com
X-Msg-Ref: server-3.tower-119.messagelabs.com!1314323025!35977109!1
X-Originating-IP: [144.160.20.145]
X-StarScan-Version: 6.3.6; banners=-,-,-
X-VirusChecked: Checked
Received: (qmail 11115 invoked from network); 26 Aug 2011 01:43:45 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-3.tower-119.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 26 Aug 2011 01:43:45 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7Q1iBDe007982 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 21:44:11 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7Q1i3m7007883 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 21:44:04 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7Q1ha7U009881 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 21:43:36 -0400
Received: from dns.maillennium.att.com (dns.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7Q1hV8H009735 for <xml2rfc-dev@ietf.org>; Thu, 25 Aug 2011 21:43:33 -0400
Received: from [135.70.208.219] (vpn-135-70-208-219.vpn.east.att.com[135.70.208.219]) by maillennium.att.com (mailgw1) with ESMTP id <20110826014330gw100e4lele> (Authid: tony); Fri, 26 Aug 2011 01:43:31 +0000
X-Originating-IP: [135.70.208.219]
Message-ID: <4E56FA3F.5030807@att.com>
Date: Thu, 25 Aug 2011 21:43:27 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:6.0) Gecko/20110812 Thunderbird/6.0
MIME-Version: 1.0
To: Josh Bothun <jbothun@concentricsky.com>
References: <E1QwhM9-0004E1-F7@zinfandel.tools.ietf.org> <4E56C369.6090201@att.com> <EEC985FB-ACEB-408D-A8FB-D8714DCB5B19@concentricsky.com>
In-Reply-To: <EEC985FB-ACEB-408D-A8FB-D8714DCB5B19@concentricsky.com>
Content-Type: multipart/alternative; boundary="------------010208080208050302090501"
Cc: xml2rfc-dev@ietf.org
Subject: Re: [xml2rfc-dev] [svnhook] Svn commit to tools/xml2rfc
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Aug 2011 01:42:33 -0000

This is a multi-part message in MIME format.
--------------010208080208050302090501
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 8/25/2011 7:29 PM, Josh Bothun wrote:
> Hi Tony,
>
> On Aug 25, 2011, at 2:49 PM, Tony Hansen wrote:
>
>> I installed this version on xml.resource.org <http://xml.resource.org>.
>>
>> I'm having a problem getting it to find external references when 
>> invoked from the web (http://xml.resource.org/experimental.html).
>>
>> Try sending it draft-ietf-iri-4395bis-irireg-03.xml
>>
>> I printed out the value of $XML_LIBRARY to help debug this.
>>
>> Are there additional options I can invoke xml2rfc2 with (in addition 
>> to --verbose) that will tell us *where* it's looking for its references?
>
> I see the error -- this is odd.   The reason the error simply says:
>
> Unable to resolve external request: 
> "http://xml.resource.org/public/rfc/bibxml/reference.RFC.3987.xml"
>
> instead of giving a list of locations it tried is because the source 
> document asks for that full URL, so no other locations are tried.  Why 
> its failing on a perfectly valid URL, however, I'm not sure of yet. 
>  It works fine on my local machine, and hopefully yours as well.  I 
> will look into this.

It may be an issue with permissions on the cache. Error messages to that 
effect would be useful.

I'm pretty sure xml2rfc1 looks up the files for full URLs in 
$XML_LIBRARY first *before* trying to find them on the network, so 
that's probably a compatibility bug.

>> Also, it doesn't appear that xml2rfc is exiting with an error code 
>> when it cannot parse the file. Please add an exit non-zero (e.g. 1) 
>> or its equivalent for any failures.
>
> Sure, will do.

thanks!

     Tony

>
> -josh
>
>>
>>    Tony
>>
>> On 8/25/2011 5:20 PM, www-data wrote:
>>> jbothun@concentricsky.com <mailto:jbothun@concentricsky.com> has 
>>> made a new SVN commit in
>>> tools/xml2rfc/version2 [524]:
>>>
>>> Caching resolver will print both URL and cache locations if --verbose
>>>
>>> "Index" section skipped if no irefs are registered
>>>
>>> Svn: http://svn.tools.ietf.org/svn/tools/xml2rfc//version2
>>> Trac: 
>>> http://trac.tools.ietf.org/tools/xml2rfc/trac//changeset/524/version2
>>>
>>> Files:
>>>
>>> U   version2/cli/xml2rfc/parser.py
>>> U   version2/cli/xml2rfc/writers/base.py
>>> U   version2/cli/xml2rfc/writers/paginated_txt.py
>>>
>

--------------010208080208050302090501
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
    <link href="chrome://translator/skin/floatingPanel.css"
      type="text/css" rel="stylesheet">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    On 8/25/2011 7:29 PM, Josh Bothun wrote:
    <blockquote
      cite="mid:EEC985FB-ACEB-408D-A8FB-D8714DCB5B19@concentricsky.com"
      type="cite">Hi Tony,
      <div><br>
        <div>
          <div>On Aug 25, 2011, at 2:49 PM, Tony Hansen wrote:</div>
          <br class="Apple-interchange-newline">
          <blockquote type="cite">
            <div>I installed this version on <a moz-do-not-send="true"
                href="http://xml.resource.org">xml.resource.org</a>.<br>
              <br>
              I'm having a problem getting it to find external
              references when invoked from the web (<a
                moz-do-not-send="true"
                href="http://xml.resource.org/experimental.html">http://xml.resource.org/experimental.html</a>).<br>
              <br>
              Try sending it draft-ietf-iri-4395bis-irireg-03.xml<br>
              <br>
              I printed out the value of $XML_LIBRARY to help debug
              this.<br>
              <br>
              Are there additional options I can invoke xml2rfc2 with
              (in addition to --verbose) that will tell us *where* it's
              looking for its references?<br>
            </div>
          </blockquote>
          <div><br>
          </div>
          <div>I see the error -- this is odd. &nbsp; The reason the error
            simply says:</div>
          <div><br>
          </div>
          <div><span class="Apple-tab-span" style="white-space:pre"> </span>&nbsp;<span
              class="Apple-style-span" style="font-family: monospace;
              white-space: pre; ">Unable to resolve external request: "<a
                moz-do-not-send="true"
                href="http://xml.resource.org/public/rfc/bibxml/reference.RFC.3987.xml">http://xml.resource.org/public/rfc/bibxml/reference.RFC.3987.xml</a>"</span></div>
          <div><span class="Apple-style-span" style="font-family:
              monospace; white-space: pre; "><br>
            </span></div>
          <div>instead of giving a list of locations it tried is because
            the source document asks for that full URL, so no other
            locations are tried. &nbsp;Why its failing on a perfectly valid
            URL, however, I'm not sure of yet. &nbsp;It works fine on my
            local machine, and hopefully yours as well. &nbsp;I will look
            into this.</div>
        </div>
      </div>
    </blockquote>
    <br>
    It may be an issue with permissions on the cache. Error messages to
    that effect would be useful.<br>
    <br>
    I'm pretty sure xml2rfc1 looks up the files for full URLs in
    $XML_LIBRARY first *before* trying to find them on the network, so
    that's probably a compatibility bug.<br>
    <br>
    <blockquote
      cite="mid:EEC985FB-ACEB-408D-A8FB-D8714DCB5B19@concentricsky.com"
      type="cite">
      <div>
        <div>
          <blockquote type="cite">
            <div>Also, it doesn't appear that xml2rfc is exiting with an
              error code when it cannot parse the file. Please add an
              exit non-zero (e.g. 1) or its equivalent for any failures.<br>
            </div>
          </blockquote>
          <div><br>
          </div>
          <div>Sure, will do.</div>
        </div>
      </div>
    </blockquote>
    <br>
    thanks!<br>
    <br>
    &nbsp;&nbsp;&nbsp; Tony<br>
    <br>
    <blockquote
      cite="mid:EEC985FB-ACEB-408D-A8FB-D8714DCB5B19@concentricsky.com"
      type="cite">
      <div>
        <div>
          <div><br>
          </div>
          <div>-josh</div>
          <br>
          <blockquote type="cite">
            <div><br>
              &nbsp;&nbsp;&nbsp;Tony<br>
              <br>
              On 8/25/2011 5:20 PM, www-data wrote:<br>
              <blockquote type="cite"><a moz-do-not-send="true"
                  href="mailto:jbothun@concentricsky.com">jbothun@concentricsky.com</a>
                has made a new SVN commit in<br>
              </blockquote>
              <blockquote type="cite">tools/xml2rfc/version2 [524]:<br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
              <blockquote type="cite">Caching resolver will print both
                URL and cache locations if --verbose<br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
              <blockquote type="cite">"Index" section skipped if no
                irefs are registered<br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
              <blockquote type="cite">Svn: &nbsp;<a moz-do-not-send="true"
                  href="http://svn.tools.ietf.org/svn/tools/xml2rfc//version2">http://svn.tools.ietf.org/svn/tools/xml2rfc//version2</a><br>
              </blockquote>
              <blockquote type="cite">Trac: <a moz-do-not-send="true"
href="http://trac.tools.ietf.org/tools/xml2rfc/trac//changeset/524/version2">http://trac.tools.ietf.org/tools/xml2rfc/trac//changeset/524/version2</a><br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
              <blockquote type="cite">Files:<br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
              <blockquote type="cite">U &nbsp;&nbsp;version2/cli/xml2rfc/parser.py<br>
              </blockquote>
              <blockquote type="cite">U
                &nbsp;&nbsp;version2/cli/xml2rfc/writers/base.py<br>
              </blockquote>
              <blockquote type="cite">U
                &nbsp;&nbsp;version2/cli/xml2rfc/writers/paginated_txt.py<br>
              </blockquote>
              <blockquote type="cite"><br>
              </blockquote>
            </div>
          </blockquote>
        </div>
      </div>
      <div><br>
      </div>
    </blockquote>
    <div style="bottom: auto; left: 247px; right: auto; top: 191px;"
      class="translator-theme-default" id="translator-floating-panel">
      <div title="Click to translate"
        id="translator-floating-panel-button"></div>
    </div>
  </body>
</html>

--------------010208080208050302090501--

From tony@att.com  Fri Aug 26 14:21:29 2011
Return-Path: <tony@att.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 86DDD21F8C33; Fri, 26 Aug 2011 14:21:29 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -106.227
X-Spam-Level: 
X-Spam-Status: No, score=-106.227 tagged_above=-999 required=5 tests=[AWL=0.372, BAYES_00=-2.599, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id i28N7euswYNU; Fri, 26 Aug 2011 14:21:28 -0700 (PDT)
Received: from mail120.messagelabs.com (mail120.messagelabs.com [216.82.250.83]) by ietfa.amsl.com (Postfix) with ESMTP id A64D321F8C35; Fri, 26 Aug 2011 14:21:27 -0700 (PDT)
X-VirusChecked: Checked
X-Env-Sender: tony@att.com
X-Msg-Ref: server-11.tower-120.messagelabs.com!1314393762!35000387!1
X-StarScan-Version: 6.2.17; banners=-,-,-
X-Originating-IP: [144.160.20.145]
Received: (qmail 10629 invoked from network); 26 Aug 2011 21:22:43 -0000
Received: from sbcsmtp6.sbc.com (HELO mlpd192.enaf.sfdc.sbc.com) (144.160.20.145) by server-11.tower-120.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 26 Aug 2011 21:22:43 -0000
Received: from enaf.sfdc.sbc.com (localhost.localdomain [127.0.0.1]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7QLN8u3024218; Fri, 26 Aug 2011 17:23:09 -0400
Received: from alpd052.aldc.att.com (alpd052.aldc.att.com [130.8.42.31]) by mlpd192.enaf.sfdc.sbc.com (8.14.4/8.14.4) with ESMTP id p7QLN3wH024115; Fri, 26 Aug 2011 17:23:04 -0400
Received: from aldc.att.com (localhost.localdomain [127.0.0.1]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7QLMbvm021183; Fri, 26 Aug 2011 17:22:37 -0400
Received: from mailgw1.maillennium.att.com (mailgw1.maillennium.att.com [135.25.114.99]) by alpd052.aldc.att.com (8.14.4/8.14.4) with ESMTP id p7QLMTVK020784; Fri, 26 Aug 2011 17:22:29 -0400
Received: from [135.70.131.8] (vpn-135-70-131-8.vpn.mwst.att.com[135.70.131.8]) by maillennium.att.com (mailgw1) with ESMTP id <20110826212226gw100e4li0e> (Authid: tony); Fri, 26 Aug 2011 21:22:28 +0000
X-Originating-IP: [135.70.131.8]
Message-ID: <4E580E8C.6000008@att.com>
Date: Fri, 26 Aug 2011 17:22:20 -0400
From: Tony Hansen <tony@att.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:6.0) Gecko/20110812 Thunderbird/6.0
MIME-Version: 1.0
To: xml2rfc <xml2rfc@ietf.org>, xml2rfc-dev@ietf.org
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Subject: [xml2rfc-dev] updated experimental xml2rfc program
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Aug 2011 21:21:29 -0000

The experimental xml2rfc conversion page 
http://xml.resource.org/experimental.html has been updated with the 
latest xml2rfc version 2 beta.

I know that a lot of issues have been resolved, but there are 
undoubtedly some that have not. It's come a long way in the past few 
weeks -- feel free to give it a whirl.

     Tony Hansen
     tony@att.com

PS. Just to whet your appetites, there is a GUI version of xml2rfc2 
that's also almost ready for prime time.

From ahagens@amsl.com  Fri Aug 26 15:47:11 2011
Return-Path: <ahagens@amsl.com>
X-Original-To: xml2rfc-dev@ietfa.amsl.com
Delivered-To: xml2rfc-dev@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BBC0021F8C98 for <xml2rfc-dev@ietfa.amsl.com>; Fri, 26 Aug 2011 15:47:11 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.737
X-Spam-Level: 
X-Spam-Status: No, score=-2.737 tagged_above=-999 required=5 tests=[AWL=-0.137, BAYES_00=-2.599]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PAwXxN5rnpAw for <xml2rfc-dev@ietfa.amsl.com>; Fri, 26 Aug 2011 15:47:11 -0700 (PDT)
Received: from mail.amsl.com (mail.amsl.com [IPv6:2001:1890:123a::1:14]) by ietfa.amsl.com (Postfix) with ESMTP id 1139021F8C73 for <xml2rfc-dev@ietf.org>; Fri, 26 Aug 2011 15:47:11 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1]) by c1a.amsl.com (Postfix) with ESMTP id 202383A2002 for <xml2rfc-dev@ietf.org>; Fri, 26 Aug 2011 15:48:17 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
Received: from c1a.amsl.com ([127.0.0.1]) by localhost (c1a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NRyK6H-ZmmcI for <xml2rfc-dev@ietf.org>; Fri, 26 Aug 2011 15:48:17 -0700 (PDT)
Received: from rfc2.home (pool-72-66-107-92.washdc.fios.verizon.net [72.66.107.92]) by c1a.amsl.com (Postfix) with ESMTPSA id B348F1C38218 for <xml2rfc-dev@ietf.org>; Fri, 26 Aug 2011 15:48:16 -0700 (PDT)
From: Alice Hagens <ahagens@amsl.com>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Date: Fri, 26 Aug 2011 18:46:56 -0400
Message-Id: <7B89CB74-7AFA-465D-987C-E8A86A82C774@amsl.com>
To: XML Developer List <xml2rfc-dev@ietf.org>
Mime-Version: 1.0 (Apple Message framework v1084)
X-Mailer: Apple Mail (2.1084)
Subject: [xml2rfc-dev] bug in txt and nroff output when using hangIndent
X-BeenThere: xml2rfc-dev@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: "Discussion about particulars of xml2rfc development and code." <xml2rfc-dev.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/xml2rfc-dev>
List-Post: <mailto:xml2rfc-dev@ietf.org>
List-Help: <mailto:xml2rfc-dev-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/xml2rfc-dev>, <mailto:xml2rfc-dev-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 26 Aug 2011 22:47:11 -0000

Greetings,
Thanks for all the work on this.=20

Looking at the output - specifically when using list style=3D"hanging" =
hangIndent=3D"X". For example, testing =
draft-ietf-morg-multimailbox-search-07.xml (as available from =
http://www.ietf.org/id/draft-ietf-morg-multimailbox-search-07.xml) using =
http://xml.resource.org/experimental.html.

in XML:

    <section title=3D"New ESEARCH command">
      <t>
        <list style=3D"hanging" hangIndent=3D"12">
        <t hangText=3D"Arguments:">OPTIONAL source options<vspace/>
          OPTIONAL result options<vspace/>
          OPTIONAL charset specification (see <xref =
target=3D"RFC2978"/>)<vspace/>
          searching criteria (one or more)
        </t>
	<t hangText=3D"Responses:">REQUIRED untagged response: =
ESEARCH<vspace/>
        </t>
        <t hangText=3D"Result:">OK - search completed<vspace/>
          NO - error: cannot search that charset or criteria<vspace/>
          BAD - command unknown or arguments invalid
        </t>
        </list>
      </t>


experimental text output:
2.  New ESEARCH command
   Arguments: OPTIONAL source options
               OPTIONAL result options
               OPTIONAL charset specification (see [RFC2978])
               searching criteria (one or more)

   Responses: REQUIRED untagged response: ESEARCH

   Result: OK - search completed
               NO - error: cannot search that charset or criteria
               BAD - command unknown or arguments invalid

experimental nroff output:
.ti 0
2.  New ESEARCH command

.in 15
.ti 3
Arguments: OPTIONAL source options
.in 3
OPTIONAL result options
OPTIONAL charset specification (see [RFC2978])
searching criteria (one or more)

.in 15
.ti 3
Responses: REQUIRED untagged response: ESEARCH

.ti 3
Result: OK - search completed
.in 3
NO - error: cannot search that charset or criteria
BAD - command unknown or arguments invalid

which yields text output:

2.  New ESEARCH command

   Arguments: OPTIONAL source options
   OPTIONAL result options OPTIONAL charset specification (see
   [RFC2978]) searching criteria (one or more)

   Responses: REQUIRED untagged response: ESEARCH

   Result: OK - search completed
   NO - error: cannot search that charset or criteria BAD - command
   unknown or arguments invalid


The production text output is the desired output (or one less space =
after the colon would be fine as well):

2.  New ESEARCH command

   Arguments:  OPTIONAL source options
               OPTIONAL result options
               OPTIONAL charset specification (see [RFC2978])
               searching criteria (one or more)

   Responses:  REQUIRED untagged response: ESEARCH

   Result:     OK - search completed
               NO - error: cannot search that charset or criteria
               BAD - command unknown or arguments invalid


side note: For this specific example, the production nroff output seems =
to be ok. (However, in general, there is an existing issue in xml2nroff =
which was mentioned in the RFP as "Note: in the current nroff output =
hangIndent does not have the expected result when the length of the =
hangText is over a certain number of characters. See =
current_output.nroff where .in 37 appears.") =20

Thanks,
Alice=
