在python中部署时组合javascript文件

在python中部署时组合javascript文件,javascript,python,deployment,buildout,jscompress,Javascript,Python,Deployment,Buildout,Jscompress,我正试图减少我们网站中包含的脚本数量,并使用buildout来处理部署。有人成功地实现了将脚本与buildout结合并压缩的方法吗?这是我制作的一个Python脚本,我在所有繁重的JavaScript项目中都使用它。我正在使用YUICompressor,但您可以更改代码以使用其他压缩器 import os, os.path, shutil YUI_COMPRESSOR = 'yuicompressor-2.4.2.jar' def compress(in_files, out_file, i

我正试图减少我们网站中包含的脚本数量,并使用buildout来处理部署。有人成功地实现了将脚本与buildout结合并压缩的方法吗?

这是我制作的一个Python脚本,我在所有繁重的JavaScript项目中都使用它。我正在使用YUICompressor,但您可以更改代码以使用其他压缩器

import os, os.path, shutil

YUI_COMPRESSOR = 'yuicompressor-2.4.2.jar'

def compress(in_files, out_file, in_type='js', verbose=False,
             temp_file='.temp'):
    temp = open(temp_file, 'w')
    for f in in_files:
        fh = open(f)
        data = fh.read() + '\n'
        fh.close()

        temp.write(data)

        print ' + %s' % f
    temp.close()

    options = ['-o "%s"' % out_file,
               '--type %s' % in_type]

    if verbose:
        options.append('-v')

    os.system('java -jar "%s" %s "%s"' % (YUI_COMPRESSOR,
                                          ' '.join(options),
                                          temp_file))

    org_size = os.path.getsize(temp_file)
    new_size = os.path.getsize(out_file)

    print '=> %s' % out_file
    print 'Original: %.2f kB' % (org_size / 1024.0)
    print 'Compressed: %.2f kB' % (new_size / 1024.0)
    print 'Reduction: %.1f%%' % (float(org_size - new_size) / org_size * 100)
    print ''

    #os.remove(temp_file)
我这样使用它(下面只是一个代码片段,并假设
compress
函数存在于当前名称空间中):

该项目附带了一个用Python编写的Javascript压缩器。尽管它与框架紧密集成,但您应该能够利用压缩程序组件。如果您获得了最新的SDK,则可以使用tool/bin/compile.py命令行工具压缩JS文件,并提供各种选项(使用-h命令行开关获取帮助)。我相信builtout可以通过shell调用这个


如果您想使用自己的Python代码,可以使用qooxdoosdk附带的Python模块(在tool/pylib/下)将压缩器绘制到自己的Python代码中。它没有文档记录,但您可以查看compile.py脚本如何实现这一点。

将Blixt的解决方案与JS Min相结合。下面是代码:

只需调用
compress(in\u文件,out\u文件)
方法

import os, os.path, shutil

# This code is original from jsmin by Douglas Crockford, it was translated to
# Python by Baruch Even. The original code had the following copyright and
# license.
#
# /* jsmin.c
#    2007-05-22
#
# Copyright (c) 2002 Douglas Crockford  (www.crockford.com)
#
# Permission is hereby granted, free of charge, to any person obtaining a copy of
# this software and associated documentation files (the "Software"), to deal in
# the Software without restriction, including without limitation the rights to
# use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
# of the Software, and to permit persons to whom the Software is furnished to do
# so, subject to the following conditions:
#
# The above copyright notice and this permission notice shall be included in all
# copies or substantial portions of the Software.
#
# The Software shall be used for Good, not Evil.
#
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
# SOFTWARE.
# */

from StringIO import StringIO

def jsmin(js):
    ins = StringIO(js)
    outs = StringIO()
    JavascriptMinify().minify(ins, outs)
    str = outs.getvalue()
    if len(str) > 0 and str[0] == '\n':
        str = str[1:]
    return str

def isAlphanum(c):
    """return true if the character is a letter, digit, underscore,
           dollar sign, or non-ASCII character.
    """
    return ((c >= 'a' and c <= 'z') or (c >= '0' and c <= '9') or
            (c >= 'A' and c <= 'Z') or c == '_' or c == '$' or c == '\\' or (c is not None and ord(c) > 126));

class UnterminatedComment(Exception):
    pass

class UnterminatedStringLiteral(Exception):
    pass

class UnterminatedRegularExpression(Exception):
    pass

class JavascriptMinify(object):

    def _outA(self):
        self.outstream.write(self.theA)
    def _outB(self):
        self.outstream.write(self.theB)

    def _get(self):
        """return the next character from stdin. Watch out for lookahead. If
           the character is a control character, translate it to a space or
           linefeed.
        """
        c = self.theLookahead
        self.theLookahead = None
        if c == None:
            c = self.instream.read(1)
        if c >= ' ' or c == '\n':
            return c
        if c == '': # EOF
            return '\000'
        if c == '\r':
            return '\n'
        return ' '

    def _peek(self):
        self.theLookahead = self._get()
        return self.theLookahead

    def _next(self):
        """get the next character, excluding comments. peek() is used to see
           if an unescaped '/' is followed by a '/' or '*'.
        """
        c = self._get()
        if c == '/' and self.theA != '\\':
            p = self._peek()
            if p == '/':
                c = self._get()
                while c > '\n':
                    c = self._get()
                return c
            if p == '*':
                c = self._get()
                while 1:
                    c = self._get()
                    if c == '*':
                        if self._peek() == '/':
                            self._get()
                            return ' '
                    if c == '\000':
                        raise UnterminatedComment()

        return c

    def _action(self, action):
        """do something! What you do is determined by the argument:
           1   Output A. Copy B to A. Get the next B.
           2   Copy B to A. Get the next B. (Delete A).
           3   Get the next B. (Delete B).
           action treats a string as a single character. Wow!
           action recognizes a regular expression if it is preceded by ( or , or =.
        """
        if action <= 1:
            self._outA()

        if action <= 2:
            self.theA = self.theB
            if self.theA == "'" or self.theA == '"':
                while 1:
                    self._outA()
                    self.theA = self._get()
                    if self.theA == self.theB:
                        break
                    if self.theA <= '\n':
                        raise UnterminatedStringLiteral()
                    if self.theA == '\\':
                        self._outA()
                        self.theA = self._get()


        if action <= 3:
            self.theB = self._next()
            if self.theB == '/' and (self.theA == '(' or self.theA == ',' or
                                     self.theA == '=' or self.theA == ':' or
                                     self.theA == '[' or self.theA == '?' or
                                     self.theA == '!' or self.theA == '&' or
                                     self.theA == '|' or self.theA == ';' or
                                     self.theA == '{' or self.theA == '}' or
                                     self.theA == '\n'):
                self._outA()
                self._outB()
                while 1:
                    self.theA = self._get()
                    if self.theA == '/':
                        break
                    elif self.theA == '\\':
                        self._outA()
                        self.theA = self._get()
                    elif self.theA <= '\n':
                        raise UnterminatedRegularExpression()
                    self._outA()
                self.theB = self._next()


    def _jsmin(self):
        """Copy the input to the output, deleting the characters which are
           insignificant to JavaScript. Comments will be removed. Tabs will be
           replaced with spaces. Carriage returns will be replaced with linefeeds.
           Most spaces and linefeeds will be removed.
        """
        self.theA = '\n'
        self._action(3)

        while self.theA != '\000':
            if self.theA == ' ':
                if isAlphanum(self.theB):
                    self._action(1)
                else:
                    self._action(2)
            elif self.theA == '\n':
                if self.theB in ['{', '[', '(', '+', '-']:
                    self._action(1)
                elif self.theB == ' ':
                    self._action(3)
                else:
                    if isAlphanum(self.theB):
                        self._action(1)
                    else:
                        self._action(2)
            else:
                if self.theB == ' ':
                    if isAlphanum(self.theA):
                        self._action(1)
                    else:
                        self._action(3)
                elif self.theB == '\n':
                    if self.theA in ['}', ']', ')', '+', '-', '"', '\'']:
                        self._action(1)
                    else:
                        if isAlphanum(self.theA):
                            self._action(1)
                        else:
                            self._action(3)
                else:
                    self._action(1)

    def minify(self, instream, outstream):
        self.instream = instream
        self.outstream = outstream
        self.theA = '\n'
        self.theB = None
        self.theLookahead = None

        self._jsmin()
        self.instream.close()

def compress(in_files, out_file, in_type='js', verbose=False,
             temp_file='.temp'):
    temp = open(temp_file, 'w')
    for f in in_files:
        fh = open(f)
        data = fh.read() + '\n'
        fh.close()

        temp.write(data)

        print ' + %s' % f
    temp.close()

    out = open(out_file, 'w')

    jsm = JavascriptMinify()
    jsm.minify(open(temp_file,'r'), out)

    out.close()

    org_size = os.path.getsize(temp_file)
    new_size = os.path.getsize(out_file)

    print '=> %s' % out_file
    print 'Original: %.2f kB' % (org_size / 1024.0)
    print 'Compressed: %.2f kB' % (new_size / 1024.0)
    print 'Reduction: %.1f%%' % (float(org_size - new_size) / org_size * 100)
    print ''

    os.remove(temp_file)
导入操作系统,操作系统路径,shutil
#这段代码源于Douglas Crockford的jsmin,它被翻译成
#巴鲁克·伊恩的《Python》。原始代码拥有以下版权和所有权:
#执照。
#
#/*jsmin.c
#    2007-05-22
#
#版权所有(c)2002道格拉斯·克罗克福德(www.Crockford.com)
#
#特此免费向任何获得以下文件副本的人员授予许可:
#本软件及相关文档文件(“软件”),用于处理
#本软件不受限制,包括但不限于
#使用、复制、修改、合并、发布、分发、再许可和/或出售副本
#并允许向其提供软件的人员执行以下操作:
#因此,在以下条件下:
#
#上述版权声明和本许可声明应包含在所有
#软件的副本或大部分。
#
#软件应用于善,而非恶。
#
#本软件按“原样”提供,无任何形式的明示或明示担保
#默示,包括但不限于适销性保证,
#适用于特定目的和非侵权。在任何情况下
#作者或版权持有人应承担任何索赔、损害或其他责任
#无论是在合同诉讼、侵权诉讼或其他诉讼中,由以下原因引起的责任:,
#与本软件有关,或与本软件的使用或其他交易有关
#软件。
# */
从StringIO导入StringIO
def jsmin(js):
ins=StringIO(js)
out=StringIO()
JavascriptMinify().minify(输入、输出)
str=outs.getvalue()
如果len(str)>0且str[0]='\n':
str=str[1:]
返回str
def isAlphanum(c):
“”“如果字符是字母、数字、下划线,
美元符号,或非ASCII字符。
"""
返回((c>='a'和c='0'和c='a'和c 126));
类未终止的注释(异常):
通过
类UnterminatedStringLiteral(异常):
通过
类UnterminatedRegularExpression(异常):
通过
类JavascriptMinify(对象):
def_outA(自我):
self.outstream.write(self.theA)
def_outB(自身):
self.outstream.write(self.theB)
def_获取(自身):
“”“从stdin返回下一个字符。注意向前看。如果
该字符是控制字符,请将其转换为空格或空格
换行。
"""
c=自发光二极管
self.thelookhead=无
如果c==无:
c=自流内读取(1)
如果c>=''或c=='\n':
返回c
如果c='':#EOF
返回“\000”
如果c=='\r':
返回'\n'
返回“”
def_窥视(自):
self.theLookahead=self.\u get()
返回自己的主页
def_下一步(自我):
“”“获取下一个字符,不包括注释。peek()用于查看
如果未转义的“/”后跟“/”或“*”。
"""
c=自我。_get()
如果c='/'和self.theA!='\\':
p=自我。_peek()
如果p=='/':
c=自我。_get()
当c>'\n'时:
c=自我。_get()
返回c
如果p=='*':
c=自我。_get()
而1:
c=自我。_get()
如果c=='*':
如果self._peek()=='/':
赛尔夫
返回“”
如果c=='\000':
提出未终止的建议()
返回c
定义动作(自我、动作):
“”“做点什么!你做什么取决于参数:
1输出A。将B复制到A。获取下一个B。
2将B复制到A。获取下一个B。(删除A)。
3获取下一个B。(删除B)。
动作将字符串视为单个字符。哇!
如果正则表达式前面有(或,或=),则操作将识别该正则表达式。
"""

如果action与Rushabh.提出的解决方案略有不同,而不是基于文件的压缩函数,那么它是基于字符串的,并且比较简单:

def jsmerge(file_names, debug=False):
"""combines several js files together, with optional minification"""
js = ""
for file_name in file_names:
    js += open(file_name).read()

# if debug is enabled, we skip the minification
if debug:
    return js
else:
    return jsmin(js)

如果您使用的是WSGI中间件,您也可以使用。将其集成到堆栈中可能比“简单地”更改构建中的内容需要更多的工作。另一方面,您使用Fanstatic获得的东西非常好。它允许您只发送每个页面所需的脚本。它还可以进行压缩(捆绑)以及缩小“资源”(JavaScript和CSS)。

我创建了一个工具,使用Python合并和缩小JS和CSS文件

这个工具使用了一个非常有用的工具
def jsmerge(file_names, debug=False):
"""combines several js files together, with optional minification"""
js = ""
for file_name in file_names:
    js += open(file_name).read()

# if debug is enabled, we skip the minification
if debug:
    return js
else:
    return jsmin(js)
{
    "js": {
        "minify_files": [
            {"from": "static/file.js", "to":"static/file.min.js"},
        ],
        "merge_files": [
            {"from" : ["static/file1.js", "static/file2.js"], "to":"static/public.js", "to_min": "static/public.min.js"}
        ]
    },
    "css" : {
        "minify_files": [
            {"from": "static/file.css", "to":"static/file.min.css"},
        ],
        "merge_files": [
            {"from" : ["static/file1.css", "static/file2.css"], "to":"static/public.css", "to_min": "static/public.min.css"}
        ]
    }
}